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SECTION  I 

INTRODUCTION 


1.  OBJECTIVES  AND  STATUS  OF  THE  RE¬ 
SEARCH 

This  annual  report  describes  the  results  obtained  during  the  second  year  of 
the  project  directed  towards  the  analysis  of  fundamental  bounds  on  the  maximal 
achievable  precision  of  aiming  of  dynamical  systems  with  random  disturbances 
and  application  of  these  bounds  to  control  of  space  structures.  The  specific 
goals  of  the  second  year  of  the  study  were  as  follows:  Conduct  research  into  and 
uncover  the  fundamental  properties  of  the  following  topics: 

1.  State  and  output  aiming  controllers  with  output  feedback:  analysis  and 
design. 

Aiming  controllers  with  noisy  measurement:  fundamental  tradeoffs. 

3.  Residence  proability  control  vs.  residence  time  control:  analysis  and  syn¬ 
thesis. 

These  goals  have  been  achieved  and  the  results  are  reported  in  Sections  II-III 
below.  The  summary  of  the  results  is  as  follows: 

Section  II  is  devoted  to  analysis  of  residence  time  control  processes  using  the 
dynamic  output  feedback.  The  main  conclusions  arrived  at  in  this  study  are: 
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1.  The  linear  system 


dx  =  (Ax  +  Bu)dt  +  eCdw  ,  x(0)  =  xo 
y  =  Dx  ,  (1.1) 

where  x  £  Rn ,  u  €  i2m,  y  £  Rp,  u;  is  a  standard  r-dimensional  Brownian  motion 
and  0  <  e  <  1,  with  the  noiseless  output  feedback 

u  =  Kx 

x  =  Ax  +  Bu  +  L(z  —  Ex)  ,  z  =  Ex  ,  z  £  Rq  ,  (1.2) 

is  pointable  with  any  desired  residence  time  if  and  only  if  it  is  invertible  and 
minimum  phase  in  an  appropriate  sense. 

2.  If  it  is  not  the  case,  the  maximal  achievable  residence  time  T*  <  oo  for 
system  (1.1),  (1.2)  coincides  with  that  for  system  with  state  feedback,  u  =  Kx, 
if  and  only  if  E(sl  -  A)~1C  is  left  invertible  and  minimum  phase;  otherwise, 
the  output  controllers  give  a  smaller  residence  time  in  comparison  with  the  state 
space  controllers. 

3.  The  residence  time  of  system  (1.1)  with  noisy  output  feedback 

u  =  Kx 

dx  =  (Ax  +  Bu)dt  +  L(dz  -  Exdt)  (1.3) 

A jl  c  JT 

where  Wx(t)  is  a  ^-dimensional  standard  Brownian  motion,  is  always  bounded, 
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T*  <  oo.  Thus,  the  measurement  noise  has  a  more  severe  effect  on  the  residence 
time  than  the  input  noise. 

4.  The  observer  gain  L  that  ensures  the  largest  possible  residence  time  in 
system  (1.1),  (1.3)  coincides  with  that  of  the  corresponding  Kalman  filter.  Thus, 
Kalman  filter  is  optimal  not  only  with  respect  to  the  standard  performance  mea¬ 
sure,  i.e.,  the  mean  square  estimation  error,  but  also  from  the  point  of  view  of 
the  residence  time. 

5.  The  feedback  gain  K  that  ensures  the  largest  possible  residence  time  in 
system  (1.1),  (1.3)  is  dependent  on  the  optimal  value  of  L  mentioned  above. 
Thus,  although  the  separation  principle  does  not  take  place,  the  situation  here 
can  be  characterized  as  semi-separation:  the  optimal  observations  do  not  depend 
on  optimal  control  but  the  optimal  control  does  depend  on  optimal  observations. 
As  a  result,  the  maximal  achievable  residence  time  for  controllers  derived  in  this 
paper  is  larger  than  that  for  LQG-designed  systems. 

Section  III  is  devoted  to  the  formulation,  justification,  and  solution  of  the 
residence  probability  control  problem  and  to  the  introduction  and  analysis  of  the 
notion  of  (Z?,  Testability.  Specifically,  if 

rXo  =  inf {t  >  0  :  x(t)  6  dD\x0  €  [£>0J)  ,  (1.4)' 

(D  C  Rn  and  Do  C  D  are  open  bounded  domains  with  0  in  their  interiors)  is  the 


3 


first  passage  time  of  the  trajectory  of  (1.1)  with 

u  =  Kx  ,  (1.5) 

from  D.  than  the  problem  of  aiming  control  can  be  reformulated  in  the  two 
following  ways: 

Residence  time  control:  Given  (1.1)  and  a  pair  ( D,T ),  find  a  feedback  law 
(1.5)  and  an  open  set  Do  C  D  such  that 

E[tXu\  ^  T  >  V  Xo  €  [2?o]  •  (1«6) 

Residence  proability  control :  Given  (1.1),  a  pair  ( D,T )  and  a  constant  0  < 
p  <  1,  find  a  feedback  law  (1.5)  and  an  open  set  D0  C  D  such  that 

Prob{rx„  >  T]  >  p  ,  Vx06[A)]  .  (1.7) 

The  residence  time  control  problem  (1.6)  and  its  generalizations  has  been 
analyzed  during  the  first  year  of  the  project  and  in  Section  II  of  this  report. 

The  residence  probability  control  (1.7)  appears  to  be  a  stronger  reformulation 
of  the  aiming  control  problem  than  the  residence  time  control.  Indeed,  since  rIn 
is  non-negative  random  variable,  the  Markov  inequality  gives: 

ProbK,  >  T)  <  . 

Therefore,  if  Prob{rX0  >  T}  >  p,  the  estimate  for  E[rXtj\  follows  immediately: 

E[rX0)  >  pT  . 


4 


Moreover,  it  is  possible  to  show  that  for  any  D ,  D0,  T  and  0  <  p  <  1  there  exists 
a  feedback  law  (1.5)  and  xq  €  Dq  such  that  the  closed  loop  system  (i,l) ,  (1.5) 
has  the  following  property: 

E[rXti]  >  T  , 

Prob{r*0  >T}  <p  . 

This  implies  that  the  closed  loop  system  may  exhibit  a  performance  as  good  as 
desired  from  the  residence  time  point  of  view  and  as  bad  as  desired  from  the 
point  of  view  of  the  residence  probability. 

These  observations  justify  the  problem  of  residence  probability  control. 

The  results  obtained  in  Section  III  with  regard  to  the  residence  probability 
control  problem  can  be  summarized  as  follows: 

1.  The  residence  probability  control  gi'  es  a  stronger  reformulation  of  the 
aiming  control  problem  than  the  residence  time  control.  However,  the  resulting 
control  problem  is  also  more  complex:  the  performance  depends  on  the  size  of 
the  initial,  “lock  in”,  domain  and  on  the  operating  period. 

2.  The  (jD,  Testability  with  probability  p  is  a  useful  tool  for  characterization 
of  the  performance  of  stochastic  systems  with  no  equilibrium  points.  The  per¬ 
formance  in  terms  of  ( D ,  Testability  may  be  contradictory  to  the  performance 

l - -  -f  t  An _ :i _ _ 

m  tcuuo  kji  iiUieiiCii* 

3.  The  residence  probability  of  a  con  .-  ;*d  linear  system  with  additive  white 
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noise  an  be  modified  in  any  desired  manner,  for  instance,  made  as  close  to  1  as 
desired,  if  and  only  if  the  range  space  of  the  noise  matrix  is  included  in  the  range 
space  of  the  control  matrix.  Otherwise,  the  achievable  residence  probability 
is  bounded  away  from  1  and  estimates  of  this  bound  are  characterized  herein 
(Section  III). 

2.  PROFESSIONAL  PERSONNEL 
ASSOCIATED  WITH  THE  PROJECT 

The  results  outlined  above  were  obtained  by  a  research  team  that  included: 

1.  Semyon  M.  Meerkov,  Professor,  Principal  Investigator. 

2.  Thordur  Runolfsson,  Post  Doctoral  Fellow  (August  1,  1988  -  January  15, 
1989).  Starting  from  January  16,  1989,  Dr.  Runolfsson  has  accepted  a  posi¬ 
tion  of  an  Assistant  Professor  in  the  Department  of  Electrical  and  Computer 
Engineering,  The  Johns  Hopkins  University,  Baltimore,  MD  21218. 

3.  Seungnam  Kim,  Doctoral  Candidate. 

3.  PAPERS  IN  THE  AREA  OF  THE  PROJECT 

[lj.  A  paper  titled  “Theory  of  Residence  Time  Control  by  Output  Feedback”, 
by  S.M.  Meerkov  and  T.  Runolfsson  has  been  accepted  for  presentation  at  the 
28th  IEEE  CDC,  Tampa,  FL,  Dec.  1989.  This  paper  comprises  Section  II  of  this 
report. 
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[2j.  A  paper,  “Theory  of  Aiming  Control  for  Linear  Stochastic  Systems”,  by 
S.  Meerkov  and  T.  Runolfsson  has  been  submitted  to  the  11th  IFAC  Congress , 
Tallinn,  U.S.S.R.,  Aug.  1990.  This  paper  is  included  as  an  Appendix  herewith. 

[3] .  A  paper,  “Aiming  Control:  Residence  Probability  and  (D,  Testability, 
by  S.  Kim,  S.M.  Meerkov  and  T.  Runolfsson,  has  been  prepared  for  submission 
to  the  29th  IEEE  CDC.  This  paper  comprises  Section  III  of  this  report. 

[4] .  A  paper:  “Aiming  Control:  Design  of  Residence  Probability  Controllers” 
is  being  prepared  for  submission  to  the  29th  IEEE  CDC. 

[5] .  A  paper,  “Output  Residence  Time  Control”  by  S.M.  Meerkov  and  T. 
Runolfsson  (reported  originally  in  the  Annual  Report  for  1987-1988)  is  to  appear 
in  the  IEEE  Trans.  Automat.  Contr..  The  galley  proofs  of  this  paper  are  included 
in  the  Appendix. 
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THEORY  OF  RESIDENCE  TIME  CONTROL 
BY  OUTPUT  FEEDBACK 


S.  M.  Meerkov 

Department  of  Electrical  Engineering 
and  Computer  Science 
The  University  of  Michigan 
Ann  Arbor,  MI  4810&-2122 

and 


T.  Runolfsson 

Department  of  Electrical  and 
Computer  Engineering 
The  Johns  Hopkins  University 
Baltimore,  MD  21218 


Abstract 

The  problem  of  residence  time  control  by  the  observer  based  out¬ 
put  feedback  is  formulated  and  solved  for  the  case  of  linear  systems 
with  small  additive  input  noise.  Both  noiseless  and  noisy  measure¬ 
ments  are  considered.  In  the  noiseless  measurements  case,  it  is  shown 
that  the  fundamental  bounds  on  the  achievable  residence  time  de¬ 
pend  on  the  nonminimum  phase  zeros  of  the  system.  In  the  noisy 
measurements  case,  the  achievable  residence  time  is  shown  to  be  al¬ 
ways  bounded,  and  an  estimate  of  ♦'■'is  bound  is  given.  Controller 
design  techniques  are  presented.  ;velopment  is  based  on  the 

asymptotic  large  deviations  theory. 


This  work  has  been  supported  by  the  Air  Force  Office  of  Scientific  Research  under  Contract 
F4962Q-87-C-0079.  The  United  States  Government  is  authorised  to  reproduce  and  distribute 
reprints  for  the  governmental  purposes  notwithstanding  any  copyright  notations  hereon. 
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1.  INTRODUCTION 


Consider  the  following  Ito  stochastic  system 

dx  —  (Ax  +  Bu)dt  4-  eCdw 
y  —  Dx  ,  (1.1) 

where  x  6  Rn,u  E  Rm,y  E  Rp,w(t )  is  a  standard  r-dimenaional  Brownian  mo¬ 
tion,  A ,  B,  C,  D  sure  matrices  of  appropriate  dimensionality,  and  0  <  e  <  1.  For  a 
given  u,  the  behavior  of  (1.1)  in  a  bounded  domain  ¥  C  Rp  can  be  characterized 
by  the  first  passage  time  [1], 

r‘(u)  =  inf  {t  >  0  :  y(t,u)  €  d¥|y(0,tt)  €  #}  , 

(dV  is  the  boundary  of  ♦),  or  by  its  average  value 

f(«)  =  £|r*(u)]  . 

The  f‘(u)  is  referred  to  as  the  (average)  residence  time  of  (1.1)  in  ¥. 

Assume  that  control  specifications  for  (1.1)  are  given  in  the  form  of  an  aiming 
(pointing)  problem:  maintain  y(t)  in  a  given  domain  V  C  Rp  during  a  specified 
time  interval  (0,T),  T  <  oo.  In  terms  of  the  average  residence  time  this  problem  • 
has  the  form 

f‘(u)  >  T  .  (1.2) 
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Technical  examples  of  this  problem  can  be  found  in  [2], 

To  accomplish  (1.2),  the  feedback  control  approach  can  be  utilized.  Papers  (2] 
and  [3]  address  this  problem  under  the  assumption  that  all  states  x  are  available 
for  control  and  u  is  chosen  as 

u  =  Kx  .  (1.3) 


In  (2]  it  was  assumed  that  D  =  I,  i.e.  the  pointing  of  states  has  been  considered, 
and  in  [3]  the  general  case  of  output  aiming  has  been  analyzed.  It  has  been 
shown  that  from  the  point  of  view  of  satisfying  (1.2),  all  systems  (1.1)  can  be 
partitioned  into  two  groups:  weakly  and  strongly  residence  time  controllable. 
Roughly  speaking,  (1.1)  is  weakly  residence  time  controllable  (tort-controllable) 
if  there  exists  T*  <  o o  such  that  the  closed  loop  system  (1.1),  (1.3)  satisfies 
(1.2)  for  T  <  T*  and  some  K  and  does  not  satisfy  (1.2)  for  T  >  T*  and  any  K. 
System  (1.1)  is  strongly  residence  time  controllable  (art-controllable)  if  T*  =  oo. 
It  has  been  shown  in  (2]  that  (x.l)  with  D  =  I  is  tort-controllable  if  and  only 
if  (j4,  B)  is  stabilizable  and  art-controllable  if  and  only  if  Im  C  C  Jm  B.  It 
has  been  shown  in  (3]  that  system  (1.1)  tort-controllable  in  states  can,  in  fact,  be 
art-controllable  in  outputs  y  ^  x.  In  particular,  it  was  shown  that  a  SISO  system 
(1.1)  is  art-controllable  if  and  only  if  all  non-minimum  phase  zeros  of  G,(s)  = 
D(aI-A)~1B  coincide  with  non-minimum  phase  zeros  of  G«(a)  =  D{oI- A)~lC. 


nU«f«  ara  nAtniaKU  wifcVi  anv  nrn- 

J/ltMtvw  V»*  V  y  r*  •* 


cision  whereas  non-minimum  phase  onja  may  or  may  not  be,  depending  on  the 
location  of  the  right  half  plane  zeros  of  Gn(s). 
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In  the  present  paper  we  address  problem  (1.2)  under  the  assumption  that  only 
(measured)  outputs  are  available  for  control  and,  therefore,  the  output  feedback 
has  to  be  utilized.  To  simplify  the  problem,  we  consider  here  the  observer  based 
output  feedback,  i.e.  controllers  of  the  form: 

u  =  Kx 

x=  Ax  +  Bu  +  L(z  —  Ex) 

if  the  measured  output, 

z  =  Ex,  z&W  ,  E&  R'*n  , 


is  noise  free,  or 

u  =  Kx 

dx  =  [Ax  +  Bu)dt  +  L(dz  -  Exdt) 
if  the  measured  output, 

dz  =  Exdt  +  €  Fdwi  , 


(1.5) 


is  noisy.  Here  u>i(t)  is  a  ^-dimensional  standard  Browni.an  motion  and  0  <  £  <  1, 
In  each  case,  (1.4)  and  (1.5),  the  problem  is  to  choose  the  pair  ( K,L )  so  that 
(1.2)  is  satisfied. 

To  this  end,  in  this  paper  we  derive  the  following  results: 

1.  System  (1.1)  with  feedback  (1.4)  is  srf-controiiabie  if  and  oniy  if  the  system 
is  invertible  and  minimum  phase  in  an  appropriate  sense. 
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2.  If  this  is  not  the  case,  the  maximal  achievable  residence  time  T*  for 
system  (1.1),  (1.4)  coincides  with  that  for  system  (1.1),  (1.3)  if  and  only  if 
£7n,(s)  =  E(sl  —  A)~1C  is  left  invertible  and  minimum  phase;  otherwise  the 
output  controllers  lead  to  a  smaller  residence  time. 

3.  System  (1.1)  with  feedback  (1.5)  is  never  ari-controllable.  Thus,  the 
measurement  noise  has  a  much  more  severe  effect  on  the  residence  time  than  the 
input  noise. 

4.  The  observer  gain  L  that  ensures  the  largest  possible  residence  time  in 
system  (1.1),  (1.5)  coincides  with  that  of  tne  corresponding  Kalman  filter.  Thus, 
Kalman  filter  is  optimal  not  only  with  respect  to  the  standard  performance  mea¬ 
sure,  i.e.,  the  mean  square  estimation  error,  but  also  from  the  point  of  view  of 
the  residence  time. 

5.  The  feedback  gain  K  that  ensures  the  largest  possible  residence  time  in 
system  (1.1),  (1.5)  is  dependent  on  the  optimal  value  of  L  mentioned  above. 
Thus,  although  the  separation  principle  does  not  take  place,  the  situation  here 
can  be  characterised  as  semi-separation:  the  optimal  observations  do  not  depend 
on  optimal  control  but  the  optimal  control  does  depend  on  optimal  observations. 
As  a  result,  the  maximal  achievable  residence  time  for  controllers  derived  in  this 
paper  is  larger  than  that  for  LQG-designed  systems. 

The  remainder  of  this  paper  is  organised  as  foiiows:  In  Section  2  some  mathe¬ 
matical  preliminaries  are  discussed.  In  Sections  3-5  system  (1.1)  with  controllers 
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(1.4)  and  (1.5),  respectively,  is  considered  and  in  Section  6  an  illustrative  exam¬ 
ple  is  given.  In  Section  7  the  conclusions  are  formulated.  The  proofs  are  given 
in  the  Appendix. 

2.  PRELIMINARIES 

In  this  section,  the  notion  of  logarithmic  residence  time,  i.e.,  the  main  tool 
of  asymptotic  analysis  of  (1.1)  with  (1.3)-(1.5),  is  introduced  and  utilized  for  a 
precise  formulation  of  problem  (1.2). 

Consider  the  linear  Ito  system 

dx  =  Axdt  +  6  Cdw 

y  -  Dx  (2.1) 

where,  as  before,  z  6  Rn,y  €  Rp,w(t)  is  a  standard  r-dimensional  Brownian 
motion  and  0  <  c  <  1.  Let  9  C  Rp  be  again  a  bounded  domain  with  the  origin 
in  its  interior  and  a  smooth  boundary  d9.  Define 

Oo  =  {*€«":  y  =  Dx  €  ¥}  ,  (2.2) 

n  =  {x  6  Rn  :  De4**  6  9,  t  >  0}  .  (2.3) 

Assume  that  z(0)  =  zo  €  Ho  and  introduce  the  first  passage  time  as 

r‘(zo)  =  inf{t  >  0  :  y(t,x0)  €  d¥}  ,  (2.4) 

where  y(t,x o)  is  the  solution  of  (2.1).  The  following  theorem  was  proved  in  (3). 


Theorem  2.1:  Suppose  A  is  Hurwitz  and  ( A,C )  is  disturbable,  i.e.  rank 
\C  AC .  ,.An~lC\  =  n.  Then  uniformly  for  all  xq  belonging  to  compact  subsets 
of  fl  we  have: 

lim€3  hif*(xo)  =  A  >  (2.5) 


where,  as  beiore,  f*(x0)  =  £?s„t*(xo)  and 

fi  =  min  \yrNy  , 

N  =  {DXDt)-\  AX  +  XAt  +  CCT  =  0  . 


(2.6) 


Constant  p,  is  referred  to  as  the  logarithmic  residence  time  of  (2.1)  in 


Let  $(t,XQ,XQ,K,  L)  be  the  solution  of  the  deterministic  system 


A  BK 

LE  A  +  BK-LE 


X 

x(0) 

*0 

& 

1 

x(0) 

£o 

Dx 


(2.7) 


and  define 


n(ff,L)  = 


*o 

£o 


Gfi 


In 


jf(t,Xo,Xo,K,L)€9,t>0 


(2.8) 


Then,  with  regard  to  control  system  (1.1)  and  controllers  (1.4)  or  (1.5),  The¬ 
orem  2.1  allows  us  to  conclude  that  for  sufficiently  small  e  and  (j")  €  U{K,L), 
problem  (1.2)  can  h?  replaced  by  an  alternative  problem  of  selecting  the  pair 
(K,  L)  such  that 

£(*;«',  I)  >  ft  (2.9) 
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where  £(¥;  K,  L)  is  the  logarithmic  residence  time  of  the  closed  loop  system  (1.1), 
(1.4)  or  (1.1),  (1.5)  and  n  =  e3  lnZ\  This  is  the  problem  solved  in  this  paper. 

As  it  was  pointed  out  in  the  Introduction,  the  solution  of  this  problem  is  given 
in  terms  of  the  weak  and  strong  residence  time  controllability  defined  precisely 
below.  In  order  to  simplify  the  notations,  we  drop  argument  W  in  (2.9). 

Definition  2.1:  (i)  System  (1.1)  is  called  weakly  residence  time  controllable 
if  for  any  bounded  domain  9  C  Rp(0  G  '£)  there  exists  controller  (1.4)  (or  (1.5)) 
such  that  p.(K,L)  >  0; 

(ii)  System  (1.1)  is  said  to  be  strongly  residence  time  controllable  if  for  any 
bounded  ¥  C  tV( 0  G  \P)  and  /*  >  0  there  exists  controller  (1.4)  (or  (1.5))  such 
that  fi(K,  L)  >  /*. 

In  what  follows,  we  will  be  assuming  that: 

Al:  (A,  C)  is  disturbable, 

A2:  (D,  A)  is  detectable, 

A3:  FFt  >  0,  and  w{t)  and  wi(t)  are  independent  Brownian  mo¬ 
tions, 

A4:  Transfer  matrices  G,(«)  =  D{aI~A)~lB,Gn{s)  =  D(sI-A)~lC 
and  G„i(s)  =  E(sl  -  A)~lC  have  full  normal  rank. 


is 


3.  NOISELESS  MEASUREMENTS  CASE 


Let  K  =  {K  <=  RMtxn  :  A  +  BK  is  Hurwitz  },  t  =  {L  <=  RnxP  :  A-LEia 
Hurwitz  }  and  define  the  maximal  logarithmic  residence  time  of  (1.1),  (1.4)  or 
(1.1),  (1.5)  in  $  as 

£*  =  sup  fi(K,L)  .  (3.1) 

KeK 
Let 

Introduce  the  following  hypotheses: 

HI:  G*(s)  is  right  invertible  and  minimum  phase. 

H2:  Gn i($)  is  left  invertible  and  minimum  phase. 

H3:  There  exists  an  mxr  rational  matrix  U  (a)  with  no  poles  in  Res  >  0  such 
that  G„(s)  +  G,(a)tf(s)  =  0. 

H4:  There  exists  a  pxg  rational  matrix  V  (s)  with  no  poles  in  Re  s  >  0  such 
that  Gn(s)  +  V(s)Gnl(s)  =  0. 

Theorem  3.1:  System  (1.1)  is 

(i)  weakly  residence  time  controllable  by  controller  (1.4)  if  and  only  if  {A,B) 
is  stabiiiiable  and  (E,  A)  is  detectable, 

(ii)  strongly  residence  time  controllable  by  controller  (1.4)  if  and  only  if  (A,  B) 
is  stabilizable,  ( E,A )  is  detectable  and  either  HI  and  H4  or  H2  and  H3  are 
satisfied. 
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Proof:  Sea  the  Appendix. 


Remark  2.1:  As  it  was  shown  in  [3j,  H3  is  the  condition  for  strong  res¬ 
idence  time  controllability  with  respect  to  the  state  space  feedback  u  =  Kx. 
Furthermore,  HI  is  a  stronger  condition  than  H3.  Thus,  either  H4  or  H2  are 
the  additional  condition  that  has  to  be  satisfied  when  the  state  space  feedback 
is  replaced  by  the  output  feedback. 

Remark  3.2:  in  SISO  case  with  D  =  E,  Theorem  3.1  implies  that  for  strong 
residence  time  controllability  G,  (s)  should  be  minimum  phase. 

A  comparison  of  the  fundamental  bounds  on  the  residence  time  achievable  by 
state  space  (1.3)  and  output  (1.4)  feedback  can  be  given  as  follows: 

Consider  the  closed  loop  system  (1.1),  (1.3),  i.e. 

dx~{A  +  BK)xdt  +  tCdw  ,  (3.2) 

and  define  as 

H*  =  sup/^ty-ff)  (3.3) 

its  maximal  logarithmic  residence  time  in  9. 

Theorem  3.2:  Equality  A*  =  M*  takes  place  if  and  only  if  G„i(s)  has  a  left 
inverse  with  no  poles  in  Re  a  >  0. 

Proof:  See  the  Appendix. 
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4.  NOISY  MEASUREMENTS  CASE 


Theorem  4.1:  Let  P  be  the  unique  positive  definite  solution  of  the  (Kalman 
filter)  Riccati  equation: 

AP  +  PAt  +  CCT  -  PET{FFr)~1EP  =  0  .  (4.1) 

Then  the  maximal  logarithmic  residence  time  of  the  closed  loop  system  (1.1), 
(1.5)  in  ¥  satisfies  the  bound 

r  -  \  yT(OPDT)-‘y  .  (4.2) 

Proof:  See  the  Appendix. 

Remark  4.1:  It  follows,  in  particular,  from  Theorem  4.1  that  since  the  upper 
bound  in  (4.2)  is  always  finite,  system  (1.1)  with  control  (1.5)  is  never  strongly 
residence  time  controllable.  Therefore,  the  measurement  noise  in  (1.5)  has  a 
greater  limiting  effect  on  the  achievable  residence  time  than  the  input  noise  in 
(1.1). 

Theorem  4.2:  The  upper  bound  (4.2)  is  attained  if  and  only  if  there  exists 
a  rational  matrix  W(«)  with  no  poles  in  Re  s  >  0  such  that 

G,(s)  +  C?,(s)Wr(s)  =  0  ,  (4.3) 

where  <7,  (a)  is  defined  as  previously  and 

G,(s)  =  D{sI-A)~lL 
L  =  PEt{FFt )~l  . 
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1 


(4.4) 

(4.5) 


Proof:  See  the  Appendix. 


Remark  4.2:  Theorem  4.2  illustrates  that  the  upper  bound  in  (4.2)  is  at¬ 
tainable.  Therefore,  it  is  the  best  possible  upper  bound. 

5.  DESIGN  TECHNIQUES 

In  the  two  previous  sections  we  have  characterized  the  fundamental  bounds 
on  the  achievable  logarithmic  residence  time.  In  this  section  we  develop  the 
controller  design  techniques  that  achieve  these  bounds.  First  system  (1.1)  with 
control  (1.5)  is  considered  and  then  system  (1.1)  with  control  (1.4)  is  addressed. 
An  example  is  given  in  Section  6. 

To  select  the  pair  {K,L}  that  maximizes  fk(K,  L)  assume,  for  simplicity,  that 
domain  ¥  is  an  ellipsoid 

¥  =  {y  €  Rp  :  yTSy  <  rJ,  5  =  ST  >  0}  .  (5.1) 

Let  W  e  Rpxp  be  a  nonsingular  matrix  such  that  5  =  WTW. 
calculations  we  obtain: 

zr  r\ 

A(K\£)  =  2A aM[WDX{K,L)DrWT)  ’ 

where  X{K,L)  is  given  by 

A  BK  X(K,L )  T{K,  L) 

LE  A  +  BK  -  LE  TT( K ,  L)  X{K,  L ) 
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Then  by  direct 

(5.2) 

(5.3) 


+ 


X(K,L)  T(K,L) 
T t(K,L)  X(K,L) 


A  BK 

LE  A  +  BK-LE 


T 


+ 


CCT 

S  0 


0 


=  0 


Therefore,  the  pair  {K,  L}  is  optimal  if  and  only  if  it  minimizes  the  largest 
eigenvalue  of  T{K,L)  =  WDX{K,L)DTWT .  The  Amae(r)  can  be  characterized 
as  follows: 

Lemma  5.1:  Let  $  >  0  be  a  scalar,  /  >  1  be  an  integer  and  select  Ki  e  K 
and  Li  €  £  such  that 

Tr  T(Ki,Li)1  <  (1-f  0)inf{Tr  T{K,L)l\K  6  /C,ju  £}  .  (5.4) 

Then 

lim  Amax(r(Ki,L,))  =  inf{AmMt(r(K,L))|K  eK,Le£}  (5.5) 

i-»  00 

Proof:  The  proof  of  this  lemma  is  similar  to  the  proof  of  Theorem  2.1  in  (7). 
We  omit  the  details  here. 

Thus,  in  order  to  minimize  AmiX(r),  we  need  only  to  minimize  Tr  r(if,  L)J,  l  - 
1, 2, 3 . . .  .  To  accomplish  this,  introduce 

J\ (K,  L)  =  Tr  T{K,  L)1  +  7  Tr  KX(K,  L)KT  ,  (5.6) 

where  X(K,L)  is  given  by  (5.3). 

Lemma  5.2:  Assume  that  K?  €  K  and  L]  €  C  minimize  J^(if,L).  Then 

Km4(K^,£?)  =  mf.  Tr  T(K,  L)‘  .  (5.7) 

'l~*  Lee 
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Proof:  The  proof  of  this  lemma  is  similar  to  the  first  part  of  the  proof  of  the 
Theorem  in  (4).  We  omit  the  details  here. 

From  Lemmas  5.1  and  5.2  follows: 

Corollary  5.1:  Assume  that  the  pair  (K?,  L'i)  with  K?  6  K  and  L]  6  t 
minimizes  J\{K,  L).  Then 

lim  lim  fllff.L?)  =  A*  •  (5-8) 

Thus,  Ki  and  L'I  provide  the  solution  to  (3.1).  A  necessary  condition  for 
the  optimality  of  (ffj7,Ljr)  in  the  sense  of  functional  (5.6)  can  be  formulated  as 
follows. 

Theorem  5.1:  Assume  that  K?  €  K  and  L]  6  Then  in  order  for  (K? ,  L'I) 


to  minimize  J^{K,L)  it  is  necessary  that 

L'I  =  L  —  PEt(FFt)~1  ,  (5.9) 

K?  =  --  BtQ1  ,  (5.10) 

where  P  is  given  by  (4.1)  and 

AtQ'I  +  QU  +  DtWtM?WD  -  i  Q1BBtQ]  =  0  ,  (5.11) 

M?  =  +  P)DTWTY~l  ,  (5.12) 

{A  +  BK?)X?  +  %?{A  +  BK?)T  +  LLT  =  0  .  (5.13) 

Proof:  See  the  Appendix. 
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Thus,  in  particular,  the  optimal  observation  gain  is  independent  of  optimal 
control  while  the  optimal  control  gain  is  a  function  of  optimal  observations. 

Since  (4.1)  has  a  positive  definite  solution,  L]  =  IG  U,  V 7,/.  The  following 
lemma  gives  a  condition  for  K?  6  K. 

Lemma  6.3:  Assume  that  M?  >  0.  Then  K?  €  K. 

Proof:  See  the  Appendix. 

Remark  6.1:  As  it  follows  from  Theorem  5.1,  the  optimal  estimator  gain  L 
given  in  (5.9)  is  tb  <  ndman  filter  gain.  Thus,  the  Kalman  filter  is  optimal  in 
optimization  problem;  {3.1).  Moreover,  consider  the  equation  for  the  estimation 

A 

error  e  =  x  -  x: 

de  =  (A-  LE)dt  +  eC  dw-  c  LFdwi  (5.14) 

and  define  its  logarithmic  residence  time  in  any  domain  A  C  Rn(0  €  A)  as 
/t(A;L).  Then 

A(A;I)  =  mm  i«rP-‘(i)e  ,  (5.15) 

where  P(L)  is  the  positive  definite  solution  of 

{A  -  LE)P{L)  +  P{L){A  -  LEf  +  CCT  +  LFFTLT  =  0  .  (5.16) 

Since  P  given  by  (4.1)  satisfies  the  inequality 

P<P{L),  WL€l  ,  (5.17) 
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we  conclude  that 


fi(A;L)  =  min  i  eTP~1e  >  fi(A ;L),  VL  6  £  .  (5.18) 

Thus,  the  Kalman  filter  is  optimal  in  the  sense  of  optimization  of  the  estimation 
error  residence  time  in  every  bounded  domain  of  Rn. 

The  optimal  control  law  for  system  (l.l)  with  control  (1.4)  can  be  obtained 
from  (5.9)  -  (5.10)  by  selecting  F  —  al  and  letting  a  — ►  0.  Indeed,  since  the 
optimal  estimator  law  for  (1.1),  (1.5)  is  the  Kalman  filter,  we  know  from  optimal 
filtering  theory  that  the  optimal  (singular)  filter  for  (1.1),  (1.4)  is  obtained  in  the 
limit  a  -*•  0  (see,  e.g..  [4]).  Therefore,  the  maximal  logarithmic  residence  time 
for  (1.1),  (1.4)  is  given  by 

A*  =  Hm  limlim.  £(*?'“,  L?‘a)  ,  (5.19) 

i-oor-Oa-O  V  ‘  ’  ‘  ’  v  ' 

where  L],a  and  K^,a  are  given  by  (5.9)  -  (5.13)  with  FF7  =  a2I. 

6.  EXAMPLE 


Consider  the  second  order  system 


y  =  [o  i}x  , 

z  =  [l  0]z  +  £  Fxvi  . 


(6.1) 
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For  this  system 


-1 


^w-y+i^w-y+i^-w-T+i 


(6.2) 


Thus,  since  G,(s)  =  Gnl(j)  is  minimum  phase,  this  system  is  srt-controikible  by 
controller  (1.4)  when  F  =  0. 

Assume  that  jF  7^  0.  Then,  by  Theorem  4.1,  the  logarithmic  residence  time 
in  the  interval  ¥  =  (—0,6),  a,i  >  0,  is  bounded  by 


•  1  r/nonTW  mm  fl,6  J 

ves*  2  *  v  ’  2\F\ 


(6.3) 


Furthermore,  when  a  =  6,  the  (sub)optimal  controller  can  be  calculated  using 
(5.9)  -  (5.13)  to  be 


L  = 


X 

FI 


,  K?  =  -(0  Kt\ 


(6.4) 


where  iCj  >  0  satisfies  the  equation 


Kh 

/|F| 


Ti  V  zif.y 


<-i 


(6.5) 


The  logarithmic  residence  time  with  this  control  is 


W,i)  = 


2  Ki 


2\F\  2K2  +  \F\  ' 


(6.6) 


Note  that  iX{K^L)  is  the  upper  bound  in  (6.3)  multiplied  by  the  factor 

2  K2 


P  = 


2K2  +  \F\  * 


(6.7) 
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Thus,  in  order  to  obtain  logarithmic  residence  time  as  close  as  desired  to  the 
maximal  value,  (6.3),  (6.7)  can  be  used  to  calculate  the  necessary  K3  (for  a  given 
p)  and  l  and  7  can  be  determined  from  (6.5). 

As  7  — *•  0  equation  (6.5)  simplifies  considerably.  Indeed,  in  this  case  Kj  -*■  00 
and,  thus,  for  3mall  7  (6.5)  becomes 

s  1  . 

Therefore, 


7.  CONCLUSIONS 

It  is  shown  in  this  paper  that  the  observer  based  output  feedback  can  be 
efficiently  used  for  pointing  of  linear  systems  subject  to  both  input  and  mea¬ 
surement  noise.  The  fundamental  bounds  on  the  achievable  precision  of  pointing 
depend  on  the  locations  of  the  right  half  plane  zeros  of  the  various  transfer  func¬ 
tions  involved.  Roughly  speaking,  the  best  precision  of  pointing  is  obtained  for 
minimum  phase  systems.  Any  desired  precision  of  aiming  is  attainable  only  if 
no  measurement  noise  is  present.  Therefore,  the  effect  of  the  measurement  noise 
on  the  achievable  precision  of  aiming  is  more  detrimental  than  that  of  the  input 
noise. 


Kh 
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APPENDIX 


Proof  of  Theorem  3.1:  The  proof  of  (i)  parallels  the  proof  of  Theorem 
3.1  in  [3j.  We  omit  the  details  here.  In  order  to  prove  (ii)  we  first  derive  the 
inequality 


r2  pR 3 

2  Tr  DX[K,L)DT  ~  ^K'L)  ~  2  Tr  DX(K,  L)DT  ’  ^ 


where  K  €■  L  €  £.  To  get  the  left  inequality  note  that 

It  1 t€ow 

m* 

t 

2Xm.[DX{K,L)Iff] 

>  r' 

~  2  Tr  DX(K,  L)DT  ' 


For  the  right  inequality  we  have  [R*  =  maxyry,  B(0,R)  =  {y|yTy  <  R2}) 

H(K,L)  =  mm\f(DX(K,L)DT)-'y 

<  min  \  yT{DX{K,L)DrYly 

=  \  Aml„|(DX(/f,£)flr)-1]fl1 

R1 

2\m„\DX(K,L)ir\ 

s  _ C  - 

“  2  Tr  ' 


It  follows  from  (A.l)  that  £*  =  oo  is  equivalent  to 

inf  Tr  DX(K,L)Dt  =  0  .  (A.2) 

ICeK 

Lee 

Next  note  that  it  follows  from  linear  quadratic  theory  [4],  [5]  that 

inf  Tr  DX{K,L)DT  =  lim  Tr  DX{K\IP)DT  (A.3) 

Let  cUo 

where 

JT  =  -  -  BtQ\  AtQ 1  +  CpA  +  DtD  -  i  Q'1BBtQ'1  =  0  ,  (A.4) 

La  =  —  —  PaET ,  APa  +  PaA  +  CCT  -  -  PaETEP*  =  0  .  (A.5) 
a  a 


Furthermore, 


lim  Tr  DX{IC,L'1)Dt  =  lim  Tr  ( DPaDT  +  aL “T  Q^L0) 


7 
a-»0 


7- 
a-*0 

=  lim  Tr  (CrQ7C  +  7  K*P*Kf)  .  (A.6) 

a-*0 


Therefore,  with  C  =  lim  v/a  La  and  D  =  lim  v/7  K1,  we  have 

a-40  v  a— *0  v 


inf  Tr  DX{K,L)Dt  =  Tr  [DP°DT  +  CTQ°C) 
KeK 
Let 

=  Tr  (DP°b7  +  CtQ°C)  . 


(A.7) 


r--u  „r  .1 —  *. - t>-  n  do  nT  tv  r>Tn^r>  t,  n  po  Tr  cT^°C  to  nnnnflff- 

u&ViU  vi  uuc  wx  mo  it  1/1  1/  j  11  v  w  )  **■*  w*»v*  a. a  >>  ^5,  w  **^»***^0 

ative.  Thus  system  (1.1)  with  control  (1.4)  is  strongly  residence  time  controllable 
if  and  only  if  all  four  terms  are  zero. 
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It  was  shown  in  [3]  that  TV  CrQ°C  =  0  if  and  only  if  there  exists  a  rational 
matrix  U (a) ,  with  no  poles  in  Re  a  >  0,  such  that 

Gn(s)  +  Gl{s)U{s)  =  0  .  (A.8) 

Similarlily,  Tr  CTQ°C  =  0,  Tr  DP°DT  =  0  and  Tr  DP°'5T  =  0  if  and  only  if 
there  exist  rational  matrices  17(a),  V (a)  and  P(a),  with  no  poles  in  Re  a  >  0, 
such  that 

Gn{s)  +  Gt{a)U{a)  =  0  ,  (A.9) 

Gn(s)  +  V(s)Gnl(s)  =  0  ,  (A.10) 

<5n(a)  +  V’CaJGnlW  =  0  (A.ll) 

where 

<5„(a)  =  D{aI-A)~lC  ,  (A.12) 

Gn{a)  =  D{aI-A)~lC  .  (A.13) 

Now,  if  Hi  is  satisfied  then  U(a)  =  —G~1(a)Gn(a)  and  U(a)  =  —G~1(a)Gn(a) 
(G 7l(s)  is  the  right  inverse  of  G,(s))  are  both  without  poles  in  Re  a  >  0  and 
satisfy  (A.8)  and  (A.9).  Therefore,  Tr  CTQ°C  =  Tr  CTQ°C  =  0.  Furthermore,  in 
this  case  DTD  =  EFD  (see,  e.g.,  [4])  and,  thus,  H4  implies  that  0  =  Tr  DP°DT  = 
Tr  P°DtD  =  TV  P°DtD  =  Tr  DP0fir.  Therefore,  by  (A.7)  the  system  is 


28 


strongly  residence  time  controllable.  Similarily,  if  H3  is  satisfied,  then  V  (s)  = 
-Gn(s)G~i(s)  and  P'(a)  =  -G„(a)G~i(a)  are  both  without  poles  in  Re  a  >  0  and, 
thus,  Tr  DP°DT  =  Tr  DP°D?  =  0.  Furthermore,  CCT  =  CCT  and,  therefore, 
H3  implies  that  0  =  Tr  CTQ°C  =  Tr  CTQ°C.  This  proves  the  sufficiency  part 
of  the  theorem. 

Assume  now  that  (1.1),  (1.4)  is  strongly  residence  time  controllable.  Then 
(A.8)  -  (A.ll)  are  satisfied  and,  thus,  H3  and  H4  are  true.  Note  that  the  existence 
of  17(a)  such  that  (A.8)  is  satisfied  and  A4  imply  that  m  >  min(p,r).  Similarly, 
the  existence  of  V  (a)‘  and  A4  imply  that  q  >  min(p,r).  Assume  p  <  r.  Then 
m  >  p  and,  thus,  G,(a)  is  right  invertible.  Similarly,  if  p  >  r,  then  q  >  r 
and  G„i(a)  is  left  invertible.  Next,  it  can  be  shown  that  (A.10)  implies  that 
G„(a)G£(--a)  =  Gn(s)G^(-a).  Furthermore,  G„(a)  has  no  zeroes  in  Re  a  >  0 
(see,  e.g.  (6)).  Similarly,  (A.8)  implies  that  Gj(-a)G„(a)  =  G^(-a)G„(a)  and 
Gn(a)  has  no  zeroes  in  Re  a  >  0.  Thus,  if  p  <  r,  i.e.  G4(j)  is  right  invertible, 
then  it  follows  from  (A.10)  and  (A.S)  that  G,(a)  has  no  zeroes  in  Re  a  >  0.  Thus 
HI  is  satisfied.  Similarily,  if  p  >  r,  then  (A.8)  and  (A.ll)  imply  that  Grti(a)  is 
left  invertible  and  minimum  phase,  i.e.,  H2  is  true.  Q.E.D. 

Proof  of  Theorem  5.2:  Let  n(K)  be  the  logarithmic  residence  time  of 
(3.12).  Then,  obviously,  for  any  K  6  K  and  L  6  £  we  have 

H(KtL)<n(K)  (A. 14) 
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and,  thus, 


sup  £(#,£)  <n{K)  .  (A.15) 

LSC 

Furthermore,  using  a  similar  argument  to  the  one  in  the  proof  of  Theorem  4.1 
(see  below)  we  have 

sup  £(if,L)  -  lim  fi(K,La)  (A.16) 

Let  «-*o 

La  _  paE 7  )  Apa  +  paAT  +  qcT  _  I  p^pjTppa  —q  ( A.i7) 

Thus,  we  want  to  show  that  left  invertibility  and  minimum  phase  of  Gni(s)  is 
necessary  and  sufficient  for 

lim  £(#,£“)  =  min  ^  yT(D(X(K)  +  P°)DT)~ly 

=  n(K)  (A.18) 

where 

(A  +  BK)X{K)  +  X(K )  (A  +  BK )  +  CCT  =  0  ( A.19) 

for  ail  K  €  K.  However,  since 

n(K)  =  min  i  yT(DX(K)DT)-‘y  ,  (A.20) 

{A  +  BK)X{K)  +  X{K){A  +  BK)T +  CCT  =  0  ,  (A.21) 

it  follows  vhat  (A.18)  is  true  if  and  only  if  DP°DT  =  0  and  CCT  =  CCT.  These 
are  exactly  the  necessary  and  sufficient  conditions  for  Grti(s)  to  be  left  invertible 
and  minimum  phase.  Q.E.D. 
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Proof  of  Theorem  4.1:  It  is  straight  forward  to  show  that  X (if,  L)  >  P 
(see,  e.g.  equation  (A.25)  below).  Therefore,  since 

£(*,£)  =  mjn  i  yT(DX(K,L)Dr)-'y  ,  (A.22) 

inequality  (4.2)  follows.  Q.E.D. 

Proof  of  Theorem  4.2:  The  logarithmic  residence  time  in  a  system  with 
the  optimal  estimator  gain  L  =  PET(FFT)~1  is 

/>(«-,£)  =  min  i  yT(D{X(K)  +  P)DT)~'y  (A.23) 

yea*  it 

where 

{A  +  BK)%{K)  +  1C{K)  +  ILT  =  0  .  (A.24) 

Thus,  the  upper-bound  (4.2)  is  attained  if  and  only  if  inf  TV  DX(K)DT  —  0. 
However,  by  the  same  argument  as  was  used  in  the  proof  of  Theorem  3.1,  this 
happens  if  and  only  if  (4.3)  is  satisfied.  Q.E.D. 

Proof  of  Theorem  5.1:  Let  L  be  the  Kalman  filter  gain  (5.9)  and  define 
dx  =  ( Ax  +  BK x)  dt  +  L(dz  -  Exdt)  (A.25) 

where  x  is  the  estimate  (1.5)  for  an  arbitrary  L.  Then  (5) 


X[K,L)  =  X{K,L)  +  P 


(A. 26) 


where  P  satisfies  (4.1)  and  X  is  given  by 


A  BK  X  Z  X  Z 

+ 

LE  A  +  BK-LE  j  \  ZT  X  }  ZT  X 


Define 


X  Xt 
X[  X , 


I  0 


I  -I  \  ZT  X 


A  BK 


LE  A  +  BK-LE 


LFFtLt  LFFtLt 
+  =  0  . 

lfftlt  lff^l7  , 


w 

X  Z  ill 

zt  x  J  y  o  -i 


(A.27) 


(A.28) 


Then 


A  +  BK  -BK 


0  A  -  LE 


X  Xx  X  Xl  A  +  BK  -BK 

+ 

Xx  X2  XT  X,  M  o  A- LE 


Xf  X2 


LFFtLt  LFF^{L  -  L)T 
+  =  0  . 

{L-L)FFtL  [L  -  L)FFT{L  -  L)T 


(A.29) 


In  order  to  show  that  K?,L  satisfy  the  necessary  conditions  for  minimizing 


J\{K,L)  we  have  to  show  that  [F  =  (£)) 


„ 


(A.30) 


gives  F  =  Fi  =  (A.30)  is  equivalent  to  showing  that 


|  J\(F  +  eA F)  =  (F),  AJ^  =  Tr  A Fr^(F)  =  0  (A.31) 
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for  all  A F  =  (£lt)  •  In  order  to  simplify  notation  we  assume  WD  —  I.  Evaluat- 

gives 


ing  ^J‘(F  +  *AF) 


<=o 


^J‘(F  +  eAF) 


l  Tr  Xl~lX'  +  7  Tr  KX'K7 
+  7Tr  AKXKt+iTt  KX&Kt  .  (A.32) 


where 


X 1  = 
X*  = 


—  X[K  +  eAK,  L  +  €  A  L) 

4 -  X(K  +  eAK,  L  +  cAL) 
de 


«=o 


«=o 


From  (A.26)  and  (A.28)  we  get  X  —  X  -  Xf  -  Xi  +  X2  and 


X1  =  X1  -X? -X,l  +  X,2  , 
X1  =  Xf  (since  P  =  const.) 


(A.33) 

(A.34) 


(A.35) 

(A.36) 


where 


X 1 


XI  = 
x;  := 


(A.37) 

(A.38) 

(A.39) 


TT  • _ it  •  •  .  /  A  AA\  _ 

using  tms  tii  gives 


+  7  Tr  KTK{1?  -  Xf  -  X[  +  X2)  (A.40) 

+  7  Tr  XKTAK  +  7  Tr  AKTKX  . 

***** 

From  (A. 29)  we  get  the  following  equations  for  X,  X\  and  Xj 

(A  +  BK)X  +  X(A  +  BK)t  -  BKXi  -  XfKTBT  +  LFFTLT  =  0  ,  (A.41) 

{A  +  BK)Xl  +  Xx{A  -  LE)t  -  BKX^  +  LFFT(L  -  if  =  0  ,  (A.42) 

(A  -  LE)Xi  +  Xj(A  -  LE)t  +  (L-  L)FFt{L  -  L)T  =  0  .  (A.43) 

Thus,  X\  X[  and  X2  satisfy 

[A  +  BK)X,  +  X*(A  +  BK)t  +  BAKX  +  XAKTBT 
-  BKX[  -  X?  KtBt  -  BAKXx  -  XlAKTBT  =  0  ,  (A.44) 

{A  +  BK)X'l  +  XJ(A  -  LEf  +  BAKXx  -  XxETALT 

-  BKX'i  -  BAKXt  -  LFFTALT  =  0  ,  (A.45) 

(A  -  LE)Xa  +  r,(A  -  LEf  -  ALEXs  -  X,ETALT 

-  (L  -  LfFFTALr  -  ALFFt{L  -  Lf  =  0  .  (A.46) 


Next  we  rewrite  (A.40)  using  (A. 35)  and  the  adjoint  equation  for  (A.44).  This 
gives 


1  ,< 

de 


J'{F  +  eAF) 


=  Tr  (XQB  +  *iXKt  -  XxQB)AK 


«=o 
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+Tr  A KT{BrQX  +  iKlC  -  BTQXf)  -  Tt(QB  +  iKt)KX'1 

/ 

-  Tr  X?Kt{3tQ  +  iK)+q  Tr  XrXX;  (A.47) 


where 

(. A  +  BK)TQ  +  Q{A  +  BK)  +  lXi-l  +  nKTK  =  Q  .  (A.48) 

Now,  it  follows  from  (A.46)  and  the  last  term  in  (A.47)  that  in  order  for  (A.47)  to 
be  zero  for  any  A L  it  is  necessary  that  X2  =  0.  Thus,  EX 2  +  FFT(L  -  L)T  —  0. 
Substituting  L  -  L  =  -X2ET(FFT)~l  into  (A.43)  gives  X2  =  0.  Therefore 

A  A 

L  =  L.  Furthermore,  with  L  =  L  and  X2  =  0  it  follows  from  (A.42)  that  for 
any  if  6  K  we  have  X\  =  0.  Therefore  X  —  X  and  the  first  two  terms  on  the 
right  hand  side  of  (A.47)  give  7 K  +  BTQ  —  0.  However,  this  makes  the  third 
and  fourth  terms  in  the  right  hand  side  of  (A.47)  also  equal  to  zero.  Therefore, 
in  order  for  (A.47)  to  be  identically  zero  for  any  A F  we  must  have  L  =  L  and 
K  =  -1BtQ. 

Finally,  substituting  K  =  K?  =  ~^BTQ  into  (A.48)  gives  (5.11)  and  (A.26), 
(A.41)  with  %  =  X*  gives  (5.13).  Q.E.D. 

Proof  of  Lemma  5.3:  Note  that  if  AfJ7  >  0  then  AfJ7  =  N?TN?  for  some  non¬ 
singular  N?.  Furthermore,  since  (D,  A)  is  detectable  it  follows  that  ( N?WD,A ) 
is  detectable.  Thus,  Q7  >  0  and  X,'7  €  K.  Q.E.D. 
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Abstract 

In  this  paper,  the  problem  of  aiming  control  is  formulated  and  analyzed  in  terms  of 
the  residence  probability  measure.  Specifically,  the  notion  of  residence  probability  in  a 
domain  is  introduced  and  its  asymptotic  expression  is  derived  for  linear  systems  with 
small,  additive  white  noise.  The  associated  notion  of  (D, Testability,  which  character¬ 
izes  the  performance  of  stochastic  systems  with  no  equilibrium  points,  is  introduced  and 
investigated.  Finally,  the  controllability  of  residence  probability  is  studied  and  the  nec¬ 
essary  and  sufficient  conditions  for  (D,T)-stabilizability  are  derived.  The  development 
is  based  on  the  asymptotic  large  deviations  theory. 
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1.  INTRODUCTION  AND  STATEMENT  OF 
THE  PROBLEM 


Consider  a  system  described  by  the  Ito  stochastic  differentia!  equation: 

dx  =  (Ax  +  Bu)dt  +  e  Cdw  ,  x(0)  =  xq  ,  (1.1) 


where  x  S  Rn,u  €  Rm,  0  <  e  <  1  and  w  is  a  standard  r-dimensional  Brownian 
motion.  Let  D  C  Rn  be  an  open  bounded  domain  with  0  in  its  interior  and 
T  <  oo  a  positive  number.  Consider  the  following  problem: 

Given  system  (1  1)  and  the  pair  (£>,  T),  find  a  feedback  law 

u-  Kx  (1.2) 


and  an  open  set  Dc  C.  D  such  that  the  closed  loop  system  (1.1),  (1.2)  has  the 
following  property: 

x(t,  Xq)  €  D,  V  f  6  (0,2*1,  ^  xo  6  (jPo)  » 


where  (D0)  is  the  closure  of  D0. 

This  problem  is  referred  to  as  the  problem  of  airr.:ng  control.  Such  a  problem 
arises  in  a  number  of  applications  where  the  goal  is  to  accomplish  a  certain  task 
during  a  specified  period  (T)  with  a  specified  accuracy  \D).  Examples  include 
the  telescope  pointing  problem  [l],  robot  arm  and  laser  beam  pointing  (2),  (3j, 
missile  terminal  guidance  (4),  etc. 
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It  is  well  known,  however,  that 


Prob{x(f,x0)  €  dD  for  some  t  >  0|x0  €  (A)]}  =  1  , 

where  dD  is  the  boundary  of  D  and  Do  is  any  open  subset  of  D ,  [5]-[7].  There¬ 
fore,  the  aiming  process  specifications,  ( D,jT),  cannot  be  met  exactly  and  some 
probabilistic  meaning  should  be  attached  to  their  interpretation.  This  can  be 
accomplished  using  the  notion  of  the  first  passage  time: 

rXo  =  inf >  0  :  x(t)  6  dD\x0  €  [D0]}  .  (1.3) 

Specifically,  the  problem  of  aiming  control  can  be  re-formulated  in  the  following 
two  probabilistic  settings: 

Residence  time  control:  Given  (l.l)  and  a  pair  ( D,T ),  find  a  feedback  law 
(1.2)  and  an  open  set  D0  C  D  such  that 

E{rt0\  >  T  ,  Vx0€[A>)  .  (1.4) 

Residence  probability  control:  Given  (1.1),  a  pair  ( D,T )  and  a  constant  0  < 
p  <  1,  find  a  feedback  law  (1.2)  and  an  open  set  Do  C  D  such  that 

Prob{r*0  >  T}  >  p  ,  V  x0  <=  [r>0]  .  (1.5) 

The  residence  time  control  problem  (1.4)  and  its  generalizations  has  been  ana¬ 
lyzed  in  (8{-(l2j.  In  these  publications,  the  fundamental  bounds  on  the  achievable 
values  of  f7(rI(()  have  been  investigated  and  the  methods  for  controllers  design, 
compatible  with  these  bounds,  have  been  developed. 
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The  residence  probability  control  (1.5)  appears  to  be  a  stronger  reformulation 
of  the  aiming  control  problem  than  the  residence  time  control.  Indeed,  since  rt0 
is  non-negative  random  variable,  the  Markov  inequality  gives: 

Prob{r„  >  T)  <  . 

Therefore,  if  Prob{r*0  >  T}  >  p,  the  estimate  for  £[rl0]  follows  immediately: 

E[rXu\>pT  . 

On  the  other  hand,  it  is  possible  to  show  (see  Appendix  4)  that  for  any  D,Dq,T 
and  0  <  p  <  1  there  exists  a  feedback  law  (1.2)  and  Xo  €  D0  such  that  the  closed 
loop  system  (1.1),  (1.2)  has  the  following  property: 

E[rt0)  >  T  , 

Prob{rX0  >  T}  <  p  . 

This  implies  that  the  closed  loop  system  may  exhibit  a  performance  as  good  as 
desired  from  the  residence  time  point  of  view  and  as  bad  as  desired  from  the 
point  of  view  of  the  residence  probability. 

These  observations  justify  the  problem  of  residence  probability  control  and, 
in  addition,  indicate  that  it  has  a  more  complicated  mathematical  structure  than 
residence  time  control  problem. 

This  paper  is  devoted  to  the  investigation  of  the  controllability  properties 
of  residence  probability,  i.e.,  to  the  question  on  when  there  exists  a  feedback 


40 


law  u  =  Kx  that  solves  the  residence  probability  control  problem.  The  related 
question  of  design  of  the  residence  probability  controllers  will  be  addressed  in  a 
companion  paper.  As  it  was  the  case  of  [8]-[l2],  the  development  is  based  on  the 
large  deviations  theory  of  [7j. 

The  idea  of  utilizing  the  residence  probability  as  a  measure  of  control  systems 
performance  is  not  new.  Apparently,  it  was  first  introduced  in  [13]  and  then 
analyzed  in  (14]-[17).  The  approach  of  [14]  is  based  on  the  stochastic  Liapunov 
functions  and  as  a  result  the  estimates  obtained  are  quite  conservative.  Indeed, 
if  (A  +  BK)  and  C  of  (1.1),  (1.2)  have  the  form  of  Example  4,  Chapter  3  of  [14], 
i.e., 

A  +  BK  = 

and  D  is  given  by 

D  =  {x  e  R*  :  -  x?  +  XjXj  +  x’  <  2}  , 

then  choosing,  for  instance,  So  =  [1  0]r,  the  approach  of  [14]  results  in 

Prob {rt0  <  T}  <  1  -  0.25c“^  .  (1.6) 

Using  the  asymptotic  method  of  this  paper,  for  the  same  example  we  obtain 

Prob {rl0  <  T}  <  ,  0  <  T  <  oo  .  (1.7) 

Obviously,  (1.6)  and  (1.7)  have  different  asymptotic  behavior:  when  6  is  very 
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small,  (1.7)  gives 


Prob{rl0  <T}  czO  , 


whereas  (1.6)  results  in 

Prob{rl0  <T}<  0.75  . 

Thus,  the  asymptotic  approach,  although  restricted  by  the  condition  6  <  1,  is 
advantageous  in  comparison  with  the  Liapunov  functions  method. 

Note  that  along  with  (6)  and  (7],  there  are  other  asymptotic  techniques  for 
calculating  the  residence  probability  (see,  for  instance,  [l8]-[20]).  However,  the 
problem  of  controllability  of  residence  probability  has  not  been  explored.  It  is 
done  in  this  paper. 

The  structure  of  the  paper  is  as  follows:  In  Section  2  an  asymptotic  formula 
for  residence  probability  in  a  domain  is  derived.  In  Section  3,  the  notion  of 
(D,  Testability,  that  characterizes  the  behavior  of  stochastic  systems  with  no 
equilibrium  points,  is  introduced  and  analyzed.  Section  4  presentes  the  conditions 
for  residence  probability  controllability  and  (D,  T)-stabilizability.  In  Section  5, 
the  conclusions  are  formulated.  The  proofs  are  given  in  Appendicies  1-4. 

2.  RESIDENCE  PROBABILITY  IN  A  DOMAIN 

Consider  the  Ito  system 

dx  =  Axdt  +  €  Cdw  ,  x(0)  =  xq  ,  (2.1) 
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where,  as  before,  x  6  Rn,  0  <  e  1  and  w  is  a  standard  r-dimensional  Brownian 
motion.  7^et  D  C  Rn  and  Do  C  D  be  open  bounded  sets  with  0  in  their  interior 
and  smooth  boundaries  dD  and  <9D0,  respectively.  The  first  passage  time  of  the 
trajectory  originating  at  xo  is 

r,o=inf{f>0:  x(t)  €  dD\x0  6  (Do)}  .  (2.2) 


As  a  random  variable,  r*0  is  characterized  by  its  probability  distribution,  i.e.,  ■ 
Prob{rIO  <  T}.  Based  on  this  distribution,  the  first  passage  probability  of  the 
trajectories  originating  in  [Do]  can  be  defined  as  follows: 

Pd0{t  <t)=  max  Prob{rl0  <  T}  .  (2.3) 

*o6|x?o) 

Then  the  residence  probability  in  the  domain  is 

P„„{r>T}  4  1  —  Pd0{t  <  T}  (2.4) 

=  .  Prob(r..  >  T)  ■ 

*o€(Do] 

These  probabilities  play  a  crucial  role  in  the  development  that  follows.  They  are 
characterized  next: 

Theorem  3.1:  Assume  that  (A,  C)  is  disturbable.  Then 
lime*  In  Pp„{r  <  T}  =  -  imn  mm  hy-eMx0)TX-1[t)(y-eMx0)  ,  (2.5) 

<-*0  *o6  Z?u  vG8D  L 

0  <KT 

where 

X{t)  =  AX{t)  +  X{t)AT  +  CCT  ,  X(0)  =  0  .  (2.6) 
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Proof:  See  Appendix  1. 


The  interpretation  of  this  result  is  as  follows:  Let  —<p(Dq)  denote  the  right 
hand  side  of  (2.5),  i.e., 

<p{Do)  =  min  min  ^[y  -  eM  Xof  X~\t){y  -  eMx0)  .  (2.7) 

‘  “  °  0<t<T 

Then,  according  to  Theorem  2.1,  if  e  is  sufficiently  small,  for  any  6  >  0, 


<  Pd0{t  <T}<t- 


g(po)-< 


1 


i.e.  Pd0{t  <  T}  is  logarithmically  equivalent  to  e  '*^d)  .  Due  to  this  reason,  <p(D0) 
is  referred  to  as  the  logarithmic  first  passage  probability.  Obviously,  the  residence 
probability  in  the  domain,  i.e.,  Pd„{t  >  T},  is  logarithmically  equivalent  to 

As  it  follows  from  the  above,  the  logarithmic  first  passage  probability  is  in¬ 
dependent  of  the  distribution  of  initial  points  xo  in  Do.  In  addition,  <p{Do)  is 
a  coordinate-free  characterization  of  system’s  performance.  Indeed,  consider  a 
similarity  transformation 

x  =  Qx,  det  Q  #  0  (2.7) 


and  the  system 

*** 

dx  =  >  +  e  Cdw  , 

A  =  Q~lAQ  ,  C  =  Q-1C  (2.8) 
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Let 


D  =  {x€Rn:  QxeD}  , 

Do  =  {i€  Rn  :  Qxq  S  Do}  . 

and  <p{Do)  be  the  logarithmic  first  passage  probability  from  D,  i.e., 

ip(D0)  =  min  min  i(y  -  e^*x0)TX~l(t)(p  -  e^xd)  . 
ie(Sol  eeav  2 
o<t<r 

Then 

Lemma  2.1:  <p{D0)  =  <p{D0). 

Proof:  See  Appendix  1. 

This  property  will  be  used  in  Section  4  to  establish  the  upper  bound  of  the 
achievable  logarithmic  first  passage  probability  for  system  (1.1). 

3.  (D, TESTABILITY 


If  a  stochastic  system  has  an  equilibrium  point,  its  stability  can  be  char¬ 
acterized  by  the  usual  notion  of  Liapunov  stability  modified  in  an  appropriate 
stochastic  sense  (14),  (21).  If  the  system  does  not  have  equilibria,  as  is  the  case 
for  (2.1),  the  Liapunov  stability  does  not  apply.  In  this  situation,  the  notion  of 
first  passage  time  could  be  used  to  describe  its  “stability”  features.  One  way  to 
accomplish  this  is  as  follows: 
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Definition  3.1:  System  (2.1)  is  said  to  be  (D,  Testable  with  probability 
0  <  p  <  1  if  there  exists  am  open  set  Do  C  D  such  that 

PDo{t  >  T}  >  p  (3.1) 

or,  equivalently, 

PDa{r<T}<l-p  ,  (3.2) 

where  Pd0{t  >  T}  and  Pd0{t  ^  T}  are  defined  in  (2.4)  and  (2.3),  respectively. 

In  this  Definition,  set  D  may  be  interpreted  as  a  safe  operating  region,  T  as 
a  desired  operating  time,  and  Do  as  an  initial,  “lock  in”,  set. 

Applying  this  definition  to  system  (2.1)  and  taking  into  account  Theorem  2.1, 
we  see  that  (2.1)  is  (D,  Testable  with  probability  p  if  there  exists  D0  C  D  such 
that 

*»(Pn) 

1  ~  t  «*  >  p  , 

where  <p{DQ)  is  the  logarithmic  first  passage  probability.  Thus,  the  analysis  of 
[D,  Testability  is  equivalent  to  the  calculation  of  <p{Do)  for  a  given  D. 

The  calculation  of  <p(D0)  according  to  (2.7)  may,  however,  be  difficult.  There¬ 
fore,  simpler  sufficient  tests  for  ( D ,  Testability  and  instability  are  given  below: 

Theorem  3.1:  Assume  that  A  is  Hurwitz,  (A,  C)  is  disturbable  and  there 
exist  a  matrix  M  >  0  and  a  number  i?o  >  0  such  that 

AtM  +MA<0 
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r  =  min  ||y|| - 7= 


»(Af) 


>0 


where  Amin(M)  is  the  smallest  eigenvalue  of  M  and  ||  •  ||  is  the  Eucledean  norm 
of  a  vector.  Then  (2.1)  is  (D,  Testable  with  probability  1  -  e~a /<s  where 


rJ 

“  <  2Am„(X(r))  ’ 


X(t)  is  the  covariance  matrix  defined  by  (2.6)  and  Amax(X(T))  is  the  largest 
eigenvalue  of  X(T).  The  corresponding  initial  set  Do  in  this  case  is: 


D0  =  {xeRn  :  xtMx<R*}  . 


Proof:  See  Appendix  2. 

Theorem  3.2:  Under  the  assumption  of  (A,C)  disturbability,  system  (2.1) 
is  not  ( D ,  Testable  with  probability  p  =  1  —  e~a^  if 

max|jy||J 
-JM£2  _<a 
2AmftX(X(r)) 

Proof:  See  Appendix  2. 


Thus  Theorems  3.1  and  3.2  provide  the  lower  and  upper  bound  for  the  resi¬ 
dence  probability  in  the  domain: 


1  J 


1-exp  {  — - 


min  ||y|| - jmJ%L= 

y  'iiuu  \“  —  /  j 


2A„,„(Af(T))e> 


}  <  Pd,{’  >T}<  1-exp  (  - 


(  53“  M2  1 


2A„ 


(X(T))e’j  ’ 

(3.3) 
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To  illustrate  the  application  of  these  bounds  and  the  utility  of  (D,  Testability, 
consider  an  example  where  two  systems  have  identical  LQG  performance  mea¬ 
sures  but  different  (D,  Testability  properties.  Specifically,  consider  system  (1.1) 
with 


and  the  initial  point  Xo  distributed  uniformly  in 

Do  =  {x0  :  x*x0  <  r3}  . 

Assume  that  the  goal  of  control  u  is  to  keep  x(t)  within 

D  =  {x :  xTx  <  R *},  R>  r 

during  the  time  period  T.  To  find  controls  that  achieve  this  goal  with  some 
accuracy,  introduce  two  performance  indecies 

J'  =  mp-£rJ*lh(x’  +  x’>>  +  ttI}it 

and 

7,  =  min^;^  [Jj(x{  +  xj)  +  0.0574  u3  dt 

Minimizing  the  expected  values  of  these  criteria,  in  the  limit  as  T  -*■  oo,  for 
R-  =  2  we  obtain 

E..W  =  =  0.0576  rJ  . 
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These  optimal  values  are  achieved  under  controls  u,-  =  K{X,  i  =  1, 2,  where 


-  (0.2949 

0.2247]  , 

(3.5) 

-  (2.3627 

3.2920]  , 

(3.6) 

respectively.  Thus,  under  gains  (3.5)  and  (3.6)  the  two  closed  loop  systems  have 
equal  LQG  performance  measures.  Next  we  investigate  their  (D,  Testability 
properties. 

Since  matrices  A  +  BK{,  i  =  1,2,  are  Hurwitz  and  pairs  (A  +  BKi,  C),  i  = 
1,2,  are  disturbable,  Theorems  3.1  and  3.2  are  applicable.  Since 

{A  +  BKi)T  +  {A  +  BKi)  <  0  ,  t  —  1,2  , 


choose  M  —  /,  min  ||y||  =  R  and  i?o  =  r.  The  calculations  of  bounds  (3.3) 
gives: 


i  - 


t 


,  -2J2L »-')* 

1  -  t  t5 


<  PD.{r(K,)  >  10}  <  1  - 

<  PD„{ r{K,)  >  10}  <  1  - 


) 


When  r  is  sufficiently  small,  the  bounds  defined  by  K\  and  do  not  overlap 
and  Pd0{t{K{)  >  10}  >  P{r(Ki )  >  10}.  Analogous  situation  takes  place  for  7”s 
other  than  10.  Indeed,  for  T  =  1  and  2’  =  0.1  we  obtain: 


1  - 
1  - 


e  3 

i.Tt(fi-r)3 

e  <J 


<  P0„{r(K,)  >  1}  <  1  -  , 

<  PdMk,)  >  1}  <  1  - 
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1  -  <  P0s{r(JS-,)  >  0.1}  <  1  -  , 

1  _  <  Pd„{t(K,)  >  0.1}  <  1  -  . 

Hence,  in  spite  of  their  equivalence  in  the  LQG-sense,  the  two  feedback  gains  are 
different  in  terms  of  the  resulting  residence  probabilities  or  (D,  Testability. 

The  LQG  and  the  residence  probability  performance  measures  could  be  in 
direct  contradiction  with  each  other.  Indeed,  continuing  example  (3.4)  with 

J{d)  =  min  jf  |-^(*J  +  x\)  +  u2  dt  , 

it  is  possible  to  show  that  J(d)  is  an  increasing  function  of  d  whereas  Pd»{t  <  T} 
is  decreasing.  This  is  illustrated  in  the  Table  below: 


D 

Pd.{t  <  1} 

Eg 

-[0.1641  0.1180) 

0.0309  r2 

5 

-[1.8397  2.3166) 

0.6419  r2 

imm 

4.  RESIDENCE  PROBABILITY  CONTROL¬ 
LABILITY  AND  (D,T)-STABILIZ ABILITY 

Consider  again  system  (1.1)  with  control  (2.1).  As  it  follows  from  Theorem 
2.1,  if  (A  +  BK,  C)  is  disturbabie, 

Iim  e:  In  PDo{r(K)  <  T)  =  -y>(A»*)  , 
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where  <p(Do ,  K)  is  the  logarithmic  first  passage  time  defined  by 
V(D*,K)=  min  min  -  e<A+BK>z„)TX-'(t,K)(!/ - '<A'l-BK>x0)  ,  (4.1) 

toGl^o)  V6ol/  / 

0  <t<T 

X(t,  K)  =  (A  +  BK)X{t ,  K)  +  X{t,  K)(A  +  BK)T  +  CCT,  X(0,  K)  =  0  . 

Note  that  if  (A,  [BC])  is  disturbable,  [A  +  BK,C)  is  disturbable  for  almost  any 
K[ 22].  We  would  like  to  choose  the  feedback  law  (1.2)  so  that  <p[Do,K)  is  as 
large  as  desired,  i.e.,  the  residence  probability,  which  is  logarithmically  equivalent 

y(Dn.K) 

to  1  —  rt  «3  ,  is  as  close  to  1  as  desired.  This  may  or  may  not  be  possible.  To 

characterize  the  various  situations,  introduce 

Definition  4.1:  System  (1.1)  is  said  to  be  strongly  residence  probability  con¬ 
trollable  (srp-controllable)  if  for  any  {D,T)  and  a  >  0  there  exists  u  =  Kx  and 
D0  C  D  such  that  <p(D0,K)  >  a.  Otherwise  the  system  is  weakly  residence 
probability  controllable. 

The  srp-controllability  is  equivalent  to  the  property  of  (£>,  T)-stabilizability: 

Definition  4.2:  System  (1.1)  is  (D,T)-stabilizable  if  for  any  ( D,T )  and 
0  <  p  <  1  there  exists  «  =  Kx  and  Do  C  D  such  that 

PDo{t  >  T)  >  p  . 

Below,  the  class  of  srp-controllable  systems  is  characterized. 

Theorem  4.1:  Under  the  assumption  of  (A,C)  disturbability,  (1.1)  is  srp- 
controllable  or,  equivalently,  (D,r)-stabilizable,  if  and  only  if  Im  C  C  Im  B. 
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Proof:  See  Appendix  3. 


If  Im  C  %  Im  B,  there  exists  an  upper  bound  on  the  achievable  <p(D0,K). 
rl  "'is  bound  is  analyzed  next. 

Consider  again  (1.1)  and  assume  that  B  has  a  full  rank.  Then  there  exists  a 
similarity  transformation  x  —  Qx  that  transfers  (1.1)  to  the  form 


dx  =  (Ax  +  Bu)dt  +  e  Cdw 


(4.2) 


A  A  A 

QAQ  =  A  - 


A. 

An 

As 

An 

I 

As 

Cl 

An 

AS 

Ah 

,  Q~1B  =  B  = 

0 

<o 

o 

II 

o 

II 

[Ci_ 

Since,  according  to  Lemma  2.1,  <p(Do,  K)  =  <p(Do,  K ),  the  bounds  will  be  estab¬ 
lished  in  terms  of  the  realization  (4.2). 


Assume  (A,  B)  is  controllable  and  choose 

1 


u  =  K,x,  Kf  =  -1BTP.  p  >  0  , 
P 


(4.3) 


where  Pp  is  the  positive  definite  solution  of 


XrPp  +  PpA  +  I--PpBBTPp  =  0  . 

p 


(4.4) 


Let  be  the  poeitive  definite  solution  of 


AuPu  +  FjiAn  +  /  —  PhAhAhPij  =  0 


(4.5) 


Let  a  and  0  be  positive  numbers  that  satisfy  the  inequality: 


+  l)||e^  ||j  <  ae~2fit  ,  (4.7) 


where  ||  •  ||3  is  the  induced  /j-norm  of  a  matrix.  Finally  let  M  >  0  and  Rq  >  0 
be  a  matrix  and  a  number,  respectively,  satisfying 


lim((A  +  BK„)tM  +  M(A  +  BKt)\  <  0 

R* 


r  =  min  ||y||  -  ..  . 


>0  . 


(4.8) 

(4.9) 


Theorem  4.2:  Under  the  assumption  of  controllability  of  {A,B)  and  dis- 
turbability  of  (A,C)  and  for  all  T  >  0  such  that 


1  -  at~2pT  >  0  , 


(4.10) 


the  maximal  achievable  logarithmic  first  passage  time,  ma x<p(D0,  Kf),  is  bounded 
as  follows: 


r*  ^  ^  ^ 

—  <  nux$(Do,K,)  =  \im<p[D0,K,)  < 


max  Hj/II1 


2A*(1 


at 


-x 


n 


(4.11) 


where 


y  _  _ Amtx(C3Cf ) _ 

2[Am»x(AjiAjl  +  AjjAjj))1/2 

A**  =  Ar  6fPn6t 


(4.12) 

(4.13) 


and  T,  Af,  a  and  0  are  defined  by  (4.9),  (4.8)  and  (4.7),  respectively. 
Proof:  See  Appendix  3. 
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Note  that  in  the  srp-controUability  case  C2  =  0,  A*  =  A**  =  0  and,  therefore, 

lim  <p(D0,  Kp)  —  oo  . 

p— o 

As  it  has  been  pointed  out  in  Section  1,  the  residence  probability  control 
problem  has  a  more  complex  nature  than  residence  time  control.  This  complexity 
manifests  itself  through  the  fact  that,  unlike  the  residence  time  (see  [8j,  formula 
(3.6)),  the  bounds  on  the  maximal  achievable  residence  probability  depend  on 
the  desired  period  of  operation  T  and,  more  importantly,  on  the  size  of  the  initial, 
“lock  in’  set  D0. 

To  illustrate  the  bounds  of  Theorem  4.3,  consider  an  example  of  the  roll 
attitude  control  problem  in  a  missile  disturbed  by  a  random  torque  [23].  The 
dynamics  of  the  system  are  described  as 


8 

0 

0 

0 

8 

1 

0 

u 

= 

10 

-1 

0 

u> 

+ 

0 

U  +  6 

1 

V 

0 

1 

0 

V 

0 

L 

0 

where  6  is  the  aileron  deflection,  u/  is  the  roll  angular  velocity,  <p  is  the  roll  angle, 
u  is  control  of  aileron  actuators  and  w  is  white  noise.  Note  that  (4.14)  is  in  the 
form  (4.2)  with  Cj  #  0,  i.e..  the  system  under  consideration  is  wrp-controllable 
and  <p{Do ,  K)  is  bounded.  To  evaluate  this  bound,  assume,  for  simplicity,  that 
D  is  a  ball  with  radius  R  and  calculate 

A*  =  0.04975  ,  A**  =  0.1  ,  a  =  12  ,  0  =  2  . 
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Choosing  Af  as 


0.25  0.25  0.25 


0.25  0.35  0.35 
0.25  0.35  1.35 


(4.15) 


and  varifying  that  (4.8)  holds,  we  finally  obtain: 

(  n  Rq  ^  10.05JR2  m  In  12 

5  R - t — -  <  hm<p(Do,Kp)  <  - — — — t=,  T  >  — —  . 

V  V0M2J  p;  l-12c-jr  2 


Thus,  there  is  no  linear  controller  (4.3)  for  missile  (4.14)  that  keeps  the  states 
in  the  ball  of  radius  R  during  interval  T  with  probability  p  >  1— exp 
On  the  other  hand,  there  exists  a  linear  state  feedback  that  accomplishes  this 
task  with  probability  p  <  1  -  exp  j— ^  } ,  provided  that  at  t  =  0  the 

states  are  locked  into  the  initial  set  Do  =  {x  :  xTMx  <  Ro},  where  M  is  given 
by  (4.15). 


5.  CONCLUSIONS 


1.  The  residence  probability  control  gives  a  stronger  reformulation  of  the 
aiming  control  problem  than  the  residence  time  control.  However,  the  resulting 
control  problem  is  also  more  complex:  the  performance  depends  on  the  size  of 
the  initial,  “lock  in” ,  domain  and  on  the  operating  period. 

O  TKa  (  D  T\.ofakJlHv  u/Sfk  nrnkokilifv  r*  im  a  itaoful  fnnl  for  rkarortttrivatmn 

*  i4V  y  }  A  y  WWWVIttV^  ft  tVM  J#*  V  »V  V»  <*v  Vk  kwk  VtMXi  ViW  »v» 

of  the  performance  of  stochastic  systems  with  no  equilibrium  points.  The  per¬ 
formance  in  terms  of  (£>,  Testability  may  be  contradictory  to  the  performance 
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in  terms  of  LQG  criterion. 


3.  The  residence  probability  of  a  controlled  linear  system  with  additive  white 
noise  can  be  modified  in  any  desired  manner,  for  instance,  made  as  close  to  1  as 
desired,  if  and  only  if  the  range  space  of  the  noise  matrix  is  included  in  the  range 
space  of  the  control  matrix.  Otherwise,  the  achievable  residence  probability  is 
bounded  away  from  1  and  estimates  of  this  bound  are  characterized  herein. 
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APPENDIX  1 


Proof  of  Theorem  2.1: 

Consider 

dx  =  Axdt  +  e  Cdw ,  x(0)  =  xq  ,  (Al.l) 


where  x  €  Rn,  0  <  e  <£  1  and  w  is  a  standard  r-dimensional  Brownian  motion. 
Let  U(t)  be  an  absolutely  continuous  function  in  Rr  and  define  FXo(U)  as  follows: 

FXo(U)  4  $  =  x0  +  f  A<f>dt  +  CU  .  (A1.2) 

Jo 


The  mapping  Flu(17)  is  continuous  with  respect  to  U  and,  assuming  without  loss 
of  generality  that  C  has  a  fuil  row  rank,  one-to-one.  Therefore,  as  it  follows  from 
Theorems  3.1  (Chapter  3)  and  1.1  (Chapter  4)  of  [7],  the  action  functional  for 
(Al.l)  is: 


Sor(<i>)  =  Sar(u)  = 


oo  ,  if  F~0l{(f>)  is  empty 

|  Jq  uTudt,  <f>  =  A<j>  +  Cu,  <f>( 0)  =  x0,  otherwise, 


(A1.3) 


where  «(<)  =  17(f). 


Define 


rt0  =  min{t :  x(t)  €  3D\xq  6  D}  , 


where  D  C  Rn  is  em  open  bounded  set  in  Rn  with  0  in  its  interior  and  smooth 


57 


boundary  dD  and  x(t)  is  the  trajectory  of  (Al.l).  Introduce  also 


Hd{T,x o)  =  {<j>  €  Cvr(Rn )  :  <f>(0)  =  zq  €  D,  <£(s)  g  D  for  some  s  €  [0,T]} 

(AM) 

Ud{T,xq)  =  {u  C  Cor(Rn)  :  ^  zq),  <£  =  A0  +  Cu,  ^(0)  =  x0}  (A1.5) 


It  follows  from  Theorems  1.1  and  1.2  (Chapter  4)  of  (7]  that  if 


Jnf  (50r(u)  :  $€[Hd(T,x o))}  =  Jnf  {Sor(u) 

u€U  d(T,xo)  uGU  d(T,xo) 


<{>  6  Hd{T,Xo)}  , 
(A1.6) 


then  uniformly  with  respect  to  all  xo  £  Rn, 

lime2lnProb{rXo  <  T}  =  -  _min  Sor(«)  .  (A1.7) 

‘-0  uei/alT, xu)  ’ 


To  prove  that  (Al.6)  holds  assume  that  the  minimum  of  Sqt{u)  on  set  Ud[T,  x0) 
is  attained  at  function  u* .  Denote  the  corresponding  <j>(t)  as  <f>*  and  assume  that 
<f>*  reaches  dD  at  t *,  i.e.,  <t>*(t')  €  dD.  Define  the  neighborhood  of  <f>*(t*)  as 
follows: 

Nr(r}(6)  =  {xeRn:  |**(f)  -  x|  <  6,  6  >  0}  . 


For  any  6  >  0,  choose  xs  €  which  is  not  contained  in  D.  Due  to  the 

assumption  that  ( A,C )  is  disturbable  there  exists  us  such  that  <£(u*(s))  =  xs  for 
some  s  €  (0,T).  Therefore,  <f>[us)  is  in  the  interior  of  Hd{T,x0).  Since  S0r(u)  is 


differentiable  and 


this  implies  that  condition  (A1.6)  is  satisfied,  and  (Al.7)  holds. 


To  solve  the  minimization  problem  of  (Al.7)  we  observe  that,  as  it  follows 
from  [7],  p.  107, 


_min  Sqt{u)  = 

u€(Jd(T,x  o) 


mm 

vedD 
o  <t<T 


V(t,  xo,y) 


(A1.8) 


where 


V  (t,  xQ,  y)  =  min 


(A1.9) 


<£  =  A<t>  +  Cu,  $(0)  =  x0,  =  y  .  (A1.10) 


Problem  (Al.9),  (Al.10)  can  be  solved  using  a  standard  variational  approach. 
The  necessary  conditions  of  optimality, 

f  =  Af  +  Cu*  ,  <£*(0)  =  Xo  ,  f{t)  =  y 

P  =  -  atp' 
u*  =  -Crp*  , 


result  in 

u'(r)  =  -CTt~AT^~T^X~l{t){y  -  eAtx0) 

and,  hence, 

V[t,x 0,y)  =  ^(y  -  eA‘xo)TX_1(0(y  -  eA‘*0)  , 

where 

X=  AX  +  XAt  +  CCT,  X(0)  =  0  . 
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Thus,  according  to  (Al.8), 


min  Sor(u)  =  min  Uy  -  tMxo)TX-l{t){ y  -  eMx0) 
ueuD(T,x o)  ggg.  2 

which,  together  with  (A1.7),  defines  the  distribution  of  the  first  passage  time  of 
a  trajectory  originating  at  x0. 

To  complete  the  proof  consider 

Pdu{t<T}=  max  Prob {rXo<T}  , 

*oG[0o| 


where  Do  C  D  is  an  open  set  containing  0  with  a  smooth  boundary  dD0.  Taking 
into  account  the  continuity  of  In  Prob{rXlt  <  T},  the  uniformity  of  the  limit  in 
(A1.7),  and  the  compactness  of  (£?0), 


lime2  In  Po0{rX0  <  T}  =  lime2  In  max  Prob{rXo  <  T} 

«-»0  t-»0  zu6[47o| 


=  lime2  max  In  Prob{rt(,  <  T}  =  max  lim  e2ln  Prob{rx  <  T} 

«-o  zn6(£»0]  1  0  ~  *  *„6[Do|«-0  1  ~  J 


=  max 

So€[Oii| 


“  ^in  -(y  -  cmXq)t X~x{t){y  -  tMxQ) 

0  <t<T 


=  “  min  -(y  -  sAex0)TX-1(t)(y  -  eAtxo) 

*o€  Du  | i€OD  i 
0<t<T 


Q.E.D. 


Proof  of  Lemma  2.1:  Since  X(t)  =  QX(t)QT, 

(y  -  e/i‘x0)TX_1(f)(y  -  eAtx0) 

=  (Q"ly  -  Q-1*AtQQ-lXo)TQTX-l{t)Q(Q'ly  -  Q-V'QQ-'x o) 
=  (y  -  eMx0)TX~l[t)(y  -  eAtx0)  . 
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Therefore, 


<p(Do) 


min  min  ^(y  --  eii‘zo)rX_1(t)(y  -  e*‘x0) 
*o£(i5o|  i&ot)  2 
o<t<r 


min  min 

*u€[.Do]  VSiJjD 
0<<<T 


i{y  -  eAtXo)T X~1(t)(y  -  «***<)) 


<£>(A))  • 


Q.E.D. 
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APPENDIX  2 


Proof  of  Theorem  3.1:  Observe  that 


< p{D0 ) 


> 


> 


•  •  \ 
mm  min  a  min 

zu€[£>o)  vGdD  2 
0<KT 

min  min  lit/  —  eAtxo||J 

zo€[/?o|  V63D  11 

o<t<r _ 

2A  max(X(T)) 


(*“»(0)|y  -  «**b||* 


Since  A  is  Hurwitz,  there  exists  M  >  0  which  satisfies 


AtM  +  MA<  0  . 


Then  D0  =  {x  6  Rn  :  xTMx  <  R$}  is  an  invariant  set  for  (2.1)  with  e  =  0.  If 


T  £  min  ||y||  -  ■rS-- 


>0  , 


this  invariant  set  is  contained  in  D.  Therefore, 

-A* _ l|2 


£>(Aj)  > 


min,  min  ||y-eA*xo|r  (  .  ....  r.  \2 

_  .  /  .  .  /  «  \  _  _  _  .  /  ••I.W 


2Am„(X(()) 


2A„„(X(()) 


A  * 

=  #1  • 


This  implies  that  (2.1)  is  (.D,  Testable  with  probability  1  -  e-a/‘*  where 


0  <  a  <  . 


Q.E.D. 
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Proof  of  Theorem  3.2: 


<P(Do)  <  mn  ^yrX“1(i)y 
0 <t<T 

<  min  ^yrAT-1(f)y=  min 

veas  2  o<t<T2  v 

o  <t<T 

R 2  A  , 

2AmiX(*(r))  2  ’ 


where  S  =  {x  €  i2n  :  ||x||  <  R}  and  R  =  max  ||y||.  This  implies  that  (2.1)  is  not 

yGdD 

(D,  Testable  with  probability  1  —  e“a/<a,  where  a  > 


Q«£*D» 
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APPENDIX  3 


Proof  of  Theorem  4.1:  Sufficiency:  If  Im  C  C  ImB,  the  disturbability 
of  ( A,C )  guarantees  the  controllability  of  (A,B).  Then,  as  it  was  shown  in  (8], 
there  exist  a  sequence  { Ka }  such  that  (A  4-  BKa)  is  Hurwitz  for  Va  6  |l,oo),  a 
set  Do  which  is  invariant  set  for  x  =  (A  4-  BKa)x  for  Va  and,  in  addition, 

lim  Xoo  {Ka)  =  0  , 

a-*oo  v 

where 

(A  +  BKa)X00{Ka)  4-  Xoo(Ka(A  4-  BKa)T  +  CCT  =  0  . 

Since  X{T,Ka)  <  Xm{Ka),  VT  >  0 

lim  X{T,Ka)  =  0  ,  VT>0  , 

a —♦00  N  1 

where 

X{t,Ka)  =  {A  +  BKa)X00{Ka)  4-  X00(ffa)(A  4-  BKaf  -t-  CCr  . 

Therefore,  by  using  Theorem  3.1, 

lim  <p{Do,  Ka)  =  oo  , 

or— *oo 

which  implies  that  (1.1)  is  srp-controllable  . 

Necessity:  Assume  that  (1.1)  is  srp-controllable.  Then  there  exists  a  se¬ 
quence  {Ka}  such  that  jiin  <p{D0-  Ka )  =  oo,  which  implies  that  Jirn  X m«(X(T,  Ka )) 
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0  or  Jim,  TrX(T,  Ka)  =  0.  Then  by  Fatau’s  lemma, 

0  =  Hm  TrX(T,Ka)  =  lim  Tr  F  e{A+BK^CCT^A+BKa<Ttdt 

a-*oo  v  '  a -♦oo  J  q 

>  j*  Jim  ij^Tr{^A+BK^iCCTe^+BK^Tt)dt  .  (A3.1) 

Since  eSA+BKa)tCCT v  t  €  [0,Tj  and  a,  (A3.1)  gives: 


lim  inf  Tr(e^A+BKa^CCT  ^A+BKa^Tt)  =0 

at-»oo  v  ' 


for  almost  all  t  €.  [0,  T*J.  Therefore,  there  exists  a  subsequence  {Kp)  of  {Ka} 
such  that 


'lim  Tr(elA+BKritCCTt(A+BKriTt)  =  0  (A3.2) 

/?— *00 

for  almost  all  t  €  (0,T).  Noting  that  X(t,Kp)  obeys  the  equation 
{A  +  BK0)X{t ,  Kp)  +  X{t,  Kp)(A  +  BKpf  +  CCT 

f  Vf  f  (A3.3) 

from  (A3.2)  and  (A3.3)  it  follows  that 

Hm[{A  +  BKp)X{t,Kp)  +  X{t,Kp){A  +  BKpf  +  CCT\  =0  (A3.4) 

for  almoet  all  t  €  (0,Tj.  Since  we  know  that  X[t,Kp)  -*  0  as  /?  -*  oo,  (A3.4) 

uupuvu  uuuv 


lim(  BKpX[t,Kp)  +  X{tyKp)Kj  BT\  +  CCT  =  0  (A3.5) 

0—+OO 
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for  almost  all  t  6  (0,  T].  Therefore,  there  exists  Q(t)  such  that 


BQ{t)  +  QT{t)BT  +  CCT  =  0 


(A3.6) 


which  is  possible  only  if  Im  C  C  Im  B. 


Q.E.D. 


Proof  of  Theorem  4.2:  From  Theorem  3.2  we  know  that 


R2 


•p(Do,K,)<x m(x(T'Kt)  ■ 


(A3. 7) 


where  R 2  =  max  llyll 2.  Ommiting,  for  the  sake  of  brevity  argument  Kf  of  function 

vedD 

X(T,KP)  and  taking  into  account  that 

X(T)  =  X.  -  e^BKt)Tx^BK.rr  _ 


where  X ^  =  lim  X(T),  the  denominator  of  (A3.7)  can  be  bounded  as 


T-*oo 


A„«(X(T))  >  Am„(X„)(l  -  ||e(',+M'|T||l) 


(A3.8) 


In  [8]  it  has  been  shown  that  Amax(Xoo)  >  A*  >  0  defined  in  (4.12).  Therefore, 

to  specify  estimate  (A3.7),  lim||e^+s^r||2  should  be  evaluated. 

^-♦0 

With  this  in  mind,  consider  the  realization  (4.2)  with  control  (4.3)  (again,  for 
simplicity  of  notations  we  drop  the  sign  A  in  all  appropriate  symbols): 


x  = 


Xi 

x2 


■<4ii  -  ~Ppu  Au  -  ^PPi2 


p 

A2 1 


*23 


*1 

Xj 


(A3.9) 
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where  P*  are  defined  by  the  positive  definite  solution  of  (4.4)  represented  as 
follows: 

_  Pf n  Ppii 

Pm. 

For  p  sufficiently  small,  (A3.9)  can  be  analyzed  using  the  singular  perturbation 
approach  (24).  This  results  in 

Pnxi(t)  =  -P12x2[t),  V  t  >  0  (A3. 10) 


where 


=  ,  Pl2  —  lim ~r  . 

>/P  P-°  sfp 


In  addition,  since  limP,  <  oo,  it  follows  from  (4.4)  that 


11X1  X  Q 
— 0  P 


lim  P0BBtP0  =  lim 


p-0 


p— *0 


Pin  PpiiPpn 

PLP.n  PLPo 


p\zrpn  *fi2rpn 
and,  therefore,  Ppn  =  Pfu  =  0  as  p  — ►  0.  Denote 


=  0 


Pjj  =  lim  Ppjj  , 

p— *o 


p\  1 

'  PnPu 

il> 

f 

i 

Pin 

PpllPpll 

.  KPn 

P[*Pn  . 

p—0  p 

.  PjnP.n 

PjnPm  . 

Then  from  the  above  considerations  it  follows  that 


Km[ArP,  +  PfA+I-^PrBBTPr) 


’  Alx 

0  0 

+ 

0 

0 

An  A 12 

^J2 

0  Pjj 

0 

P 22 

(4 

N 

_ 1 
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ph 

P11P12 

„  =0  , 

^12  . 

•  (A3. 11) 

/- 

^1  =  0  , 

(A3. 12) 

A2\P22  ~ 

-  P 11P 12  =  0  , 

(A3. 13) 

AT2P22  +  P22A22  +  I  —  PtfPi2  =  0  . 

(A3. 14) 

Since  Pp  >  0,  from  (A3. 12)  -  (A3. 14),  respectively,  we  obtain 


Pn  =  I  , 


P12  =  A2lP22 


^22P22  +  PnMl  +  I  —  P22A21A21P22  z~  0  > 


Therefore,  from  (A3. 10)  and  (A d.v) 


a?i(t)  =  -AlxP22x2{t),  t  >  0 


and 


x2(t)  =  Ai2(0>  *  >  0 


where 


^  tv 

A  =  ~ A21  "h  A22 
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is  a  Hurwitz  matrix.  Thus, 


and 


iime<A+i,*'>‘  = 

p- o 


0  -ATnP„tXt 
0  eXt 


||  lim^+^ll,  =  («**«*  +  tXTtP22A21A^P22eX% 

p—*'j 

<  (l  +  ||Pj2A2i^4^1Pj2||2)||e'^t||2  Vt  >  0  .  (A3. 15) 


Therefore,  for  a  >  0  and  (3  >  0  satisfying  (4.7),  from  (A3.8)  and  (A3. 15), 

limAm«(X(T,  tf,))  >  A*(l  -  ae~2ffT) 

and 

hmip{D0iKP)  <  _  ae-2/J T)  1  ~  ae  2pT  >  0  . 

This  provides  the  upper  bound  for  <p(Dq,Kp). 

To  obtain  the  lower  bound,  we  write 

^max  mT,K,))  < 

^max  (*„(*,))  <  Tt  X„{K,)  . 

Then,  by  [25], 

limTr  X«,{KP)  =  HmTr  CTPpC  =  Tr  C2rP22C2  =  A**  . 


Hence,  by  Theorem  3.1, 


lim  <p(D0,Kp)  > 


(r-  av..Y 

2A” 


Q.E.D. 
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APPENDIX  4 


Consider  the  closed  loop  system  (1.1),  (1.2)  with 

■  ^  • 

0  1  0 

(A  +  BK)  =  Ae(a,b)  =  ,  C=  .  (A4.1) 

-*J  k 


Since  in  the  case  of  (A4.1) 


from  (A4.2)  it  follows  that 


E[t,„  j  >  exp 


k  min  yTy 

t tedD 

\—T— 


if  b  <  a  . 


Therefore,  E[Tro]  can  be  made  as  large  as  desired  by  an  appropriate  choice  of  b. 
The  residence  probability,  as  it  follows  from  Theorem  2.1  is: 

lime3  In  Prob{rr„  <  T)  =  ~  min  (y  -  tA'Mtxo)T X~l{t){y  -  ^a'i]tx0) 

0  <KT 
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where 


>  — -  mm 
-  2  y£ 9D 

0  <t<T 


||  y  -  eA^a,^z0||2 
A  min(X(t)) 


> 


X{t)  =  Ae{a,b)X{t)  +  X{t)A*{a,b)  +  CCT ,  X{0)  >  0  . 


If  63  <  4 a, 


e*c  (a,6)t 


cos6t  +  ~sm6t  |sin6t 
_2i±ii  sjn  cog  fit-.zs-m  fit 


where  a  =  6/2  and  6  =  —  62.  Therefore, 


lim  sup  sup  ||eA-'(a,fc)‘||2  =  oo 

a-°°  «>0  ||S„||<1 


Thus,  for  any  open  Do  C  D  with  0  in  its  interior,  T  >  0,  and  6  >  0  there 
exists  xq  and  a  such  that  0  is  arbitrarily  close  to  dD  at  some  t  €  [0,  T ]. 


Then,  as  it  follows  from  (A4.3) 


Prob{rXo  <  T}  >  exp  - 


min  ||y  -  ^(»»x0in 

0  <t<T _ 

2Amin(X(t)) 


is  as  cloee  to  1  as  desired  and  Prob{rt0  >  T}  small  as  desired. 
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THEORY  OF  AIMING  CONTROL  FOR  LINEAR  STOCHASTIC  SYSTEMS 


S. M.  Meerkov 

Department  of  Electrical  Engineering  and  Computer  Science,  Tlic  Univeraity 
of  Michigan,  Ann  Arbor,  MI  48109-2122,  U.S.A. 

T.  RunoUsson 

Department  of  Electrical  and  Computer  Engineering,  The  Johns  Hopkins 
University,  Baltimore,  MD  21218,  U.S.A. 


Abstract.  The  problem  of  aiming  control  is  formulated  and  solved  for  linear  time-invariant 
systems  perturbed  by  small  additive  white  noise.  Both  state  feedback  and  dynamic  output 
feedback  laws  are  considered.  In  the  case  of  dynamic  output  feedback,  noiseless  and  noisy 
measurements  are  analyzed.  In  the  noiseless  measurement  case,  it  is  shown  that  the 
fundamental  bounds  on  the  achievable  precision  of  aiming  may  or  may  not  be  finite 
depending  on  the  nonminimum  phase  zeros  and  the  invertibility  of  the  system.  In  the  noisy 
measurement  cate  the  achievable  precision  of  aiming  is  shown  to  be  always  bounded. 
Aiming  controller  design  techniques  that  result  in  controllers  compatible  with  the  bounds 
are  developed.  The  approach  is  based  on  the  asymptotic  large  deviations  theory. 

Keywords.  Stochastic  control;  pointing  control;  large  deviations;  first  passage  times. 


INTRODUCTION 

Given  a  dynamical  system  with  state*  *  (1) ,  control  u  (() , 
output  y  (()  and  disturbances  { (t) ,  assume  its  desired  be¬ 
haviour  is  specified  by  a  pair  {*,  r},  where  ♦  is  the  domain 
to  which  the  output  y(t)  should  be  confined  and  r  is  the 
period  of  the  confinement,  i.e.,  y(<)  6  ♦,!  €  [0, r j .  For  a 
given  pair  {♦.r}  we  formulate  the  pair  of  siminy  control 
as  the  problem  of  choosing  a  feedback  control  law  a,  so  a 
to  force  the  output  y(t)  to  remain,  at  least  on  average,  in 
4  during  period  r,  in  spite  of  the  disturbance*  ( (()  that 
are  acting  on  the  system. 

Design  specifications  of  this  form  arise  in  numerous  prac¬ 
tical  control  problem,  e.g.,  telescope  pointing,  beam  point¬ 
ing,  mitdle  guidance  and  airplane  landing.  These  and  other 
examples  are  discussed  in  Meerkov  and  RunoUsson  (1988). 

Existing  control  theory  does  not  offer  tools  for  a  direct 
solution  of  tbs  aiming  control  problem  described  above. 
In  this  paper  a  theory  of  aiming  control  of  linear  systems 
perturbed  by  small  additive  white  noise  is  presented.  The 
approach  is  based  on  the  modem  asymptotic  large  devia¬ 
tions  theory. 

The  theory  described  in  this  paper  is  an  extension  of 
a  theory  developed  earlier  by  the  authors  in  Meerkov 
and  Runolfsson  (1988,  1989)  and  RunoUsson  (1989).  In 
Meerkov  and  RunoUsson  (IMS,  1989)  the  theory  was  de¬ 
veloped  for  linear  systems  with  tmaU  white  noise  perturba¬ 
tions  and  state  feedback  control  laws.  In  RunoUsson  (1989) 
systems  with  noisy  measurements  snd  direct  (static)  out¬ 
put  feedback  control  laws  were  considered.  In  the  present 
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paper  the  genearal  case  of  dynamic  output  feedback  with 
noisy  (and  noise-free)  measurements  is  considerd. 

As  in  the  earlier  papers  (Meerkov  and  RunoUsson  (19S8, 
1989))  we  divide  all  stabilizable  linear  systems  into  two 
classes,  weakly  and  strongly  residence  time  controllable. 
Roughly  speaking,  the  system  is  weakly  residence  time 
controllable  (wrt -controllable)  if  there  exists  a  0  <  r*  <  oo 
such  that  the  aiming  control  specifications  can  be  satisfied 
by  a  choice  of  u  =  u(r,x)  for  all  r  <  r*  but  not  for  any 
r  >  r*.  The  system  is  stongly  residence  time  controllable 
(sri-eoot  reliable)  if  r*  =*  oo. 

The  basic  results,  for  Unear  time  invariant  system  per¬ 
turbed  by  small  additive  white  noise,  derived  in  the  piper 
can  be  summarized  as  follows: 

1.  A  system  that  has  perfect  (i.e.,  noise-free)  measure¬ 
ments  is  sri-controllable  if  and  only  if  the  system  is 
minimum  phase  and  invertible  in  an  appropriate  sense. 

2.  Systems  with  noisy  measurements  are  never  jri- 
controllable.  Thus,  the  effect  of  the  measurement  noise 
is  more  detrimental  on  the  aiming  ability  of  a  system 
than  the  input  noise. 

3.  The  observer  gain  that  ensures  the  best  precision  of 
aiming  is  the  Kalman  filter  gain.  Thus,  the  Kalman 
filter  is  optimal  not  only  with  respect  to  the  standard 
performance  measure  (the  mean  square  estimation  er¬ 
ror)  but  also  from  the  point  of  view  of  the  residence 
time. 

4.  The  controller  gain  thst  achieve*  the  best  precision  of 
aiming  depends  on  the  optimal  value  of  the  observer 
gain.  Thus,  although  the  separation  principle  docs  not 
take  place,  the  situation  can  be  characterized  as  a  semi¬ 
separation:  the  optimal  observations  do  not  depend 
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on  the  optimal  control  but  the  optimal  control  does 
depend  on  the  optimal  observation!. 

The  paper  it  organized  at  follows:  In  Section  2  we  present 
some  mathematical  preliminaries  '  give  a  presice  for¬ 
mulation  of  the  control  problem.  In  Section  3  an  analysis 
of  residence  time  controllability  properties  is  given  and  in 
Section  4  design  techniques  are  considered.  An  illustra¬ 
tive  example  is  given  in  Section  S  and  conclusions  can  be 
found  in  Section  6.  Due  to  space  limitations,  all  proofs  are 
omitted  and  are  available  from  the  authors  upon  request. 


PRELIMINARIES  AND  PROBLEM  FORMULATION 

Consider  the  following  linear  Ito  system 

dx  =  Axdt  +  tCdw 

y  =  Dx  (1) 

where  z  g  R",y  g  R',w(t)  is  a  standard  r-dimensional 
Brownian  motion  and  0  <  c  <  1.  Let  V  C  R*  be 
a  bounded  domain  with  the  origin  in  its  interior  and  a 
smooth  boundary  d'i.  Define 

fid  =  {z  €  R"|y  =  Dx  6  *} ,  (2) 


n  =  {z€R’,|De'4,zg*,<>0].  (3) 

Assume  that  z(0)  =  x0  e  fls  and  introduce  the  first 
passage  time 

T<(xo)  —  inf  {<  >  0|y  (<,  zo)  g  *}  ,  (4) 

where  y(t,x 0)  is  the  solution  of  (1)  with  initial  condition 
zo.  The  following  theorem  was  proven  in  Meerlcov  and 
Runolfsson  (1989)  (see  also  FVeidlin  and  Wentzell  (1984)). 


Theorem  1:  Suppose  A  is  Hurwitz  and  (A,C)  is  dis- 
turbable,  i.e.,  rank(C  AC  •••  <4*_,C|  =  n.  Then  uni¬ 
formly  for  all  zo  belonging  to  compact  subsets  of  fl  we  have 


limcJln?*(zo)  *  it, 


where  f *  (zo)  =  E„  (r‘  (zo)]  and 

A 


min  \yTKy, 


N  =  ^DXDtY'  ,ax  +  X/iF  +  CCT  *  0. 


(5) 


(0) 


Constant  ft  is  referred  to  as  the  logarithmic  residence  time 
of  (l)  in  ♦. 


Consider  now  the  controlled  linear  system 

dx  *  (Ax  +  Bu )  eU  +  tCdw 
y  =  Dx 


(7) 


where  u  g  RF  is  the  coatroi.  We  assume  that  there  is 
available  for  control  purposes  a  measured  output  t  6  Bf 
and  consider  control  laws  of  the  form 


u  =  Kx 

x  *  Ax  +  Bu  +  L  (z  -  Ex) 


(8) 


if  the  measured  output  z  =  Ex  is  noise  free,  or 


u  =  Kx 

dx=(Ax  +  Bu)dt  +  L(dx-  Eidt) 
if  the  measured  output  dx  =  Exdt  +  tFdv  is  noisy.  Here, 
v(t)  is  a  g. dimensional  standard  Brownian  motion  and,  as 
before,  0  <  <  <  1. 


For  system  (7)  with  control  (8)  or  (9)  we  consider  the 
following  residence  time  control  formulation  of  the  aiming 
control  problem:  For  a  given  pair  {♦,  r }  select  the  pair 
(K,  L)  such  that  the  residence  time  in  i,  ?’  (xo,  u),  satisfies 
f(i O.u)  >  r. 


Let  y(t,xo,xo,K,  L)  be  the  solution  of  the  deterministic 
system 

\i}  =  \A  BK  jfxl  fx(0)l  fxo| 
[Fj  [LE  A  +  3K  -  LE\  [xj 1  [x(0)  J  [x0  J 

y  =  Dx. 

(10) 

Define 

n(tf,£)=  |  [!“je*,*|y(<,xo,  £)<=>M>  ol. 

(11) 

Then  with  regard  to  control  system  (7)  with  controller  (8) 
or  (9),  Theorem  1  allows  us  to  conclude  that  for  sufficiently 

small  e  and  *°]g  U(K,L),  the  above  formulation  *,f  the 
» ^  J 

residence  time  control  problem  can  be  replaced  by  the 
alternative  problem  of  selecting  the  pair  (ff,  L)  such  that 


tt(K,L)>n 


(12) 


where  (t(K,L)  is  the  logarirhmic  residence  time  of  the 
closed  loop  system  (7),  (8)  or  (7),  (9) .  and  n  =  e1  In  r. 
This  is  the  problem  considered  in  this  paper. 


Definition: 

i.  System  (7)  is  said  to  be  weakly  residence  time  control¬ 
lable  if  for  any  bounded  ♦  C  IV  (C  g  ♦)  there  exists  a 
controller  (8)  or  (9)  such  that  ft  (K,L)  >  0; 

ii.  System  (7)  is  said  to  be  strongly  residence  time  con¬ 
trollable  if  for  any  bounded  ♦  C  IV  (0  g  ♦)  and 
H  >  0  there  exists  a  controller  (8)  or  (9)  such  that 
fi(K,L)  >  n. 


Throughout  the  paper  we  make  the  following  assumptions: 

1.  ( A,C )  is  disturbabie, 

2.  (D,  A)  is  detectable, 

3.  FFT  >  0,  and  u>(t)  and  t>(f)  are  independent  Brown¬ 
ian  motions. 

4.  transfer  matrices  G,(t)  =  D(s/-  A)-1  B,  G,(s)  = 
D(sl-A)~'C  and  <7.i(s)  =*  E(sI~A)~'C  have 
full  normal  rank. 


RESIDENCE  TIME  CONTROLLABILITY 

In  this  section  we  analyze  the  achieveable  residence  time 
of  system  (7)  with  controllers  (8)  and  (9)  for  the  noiso-fice 
and  noisy  measurement  cases,  respectively. 

Let  K  =  {K  elTx,\A  +  BK  is  Hurwitz},  L  = 
(L  €  R,*,|A  -  LE  it  Hurwitz}  and  define  the  maximal 
logarithmic  residence  time  of  (7)  in  i  with  control  (8)  or 
(9)  as 


ft'  =  sup  fi(K,L).  (13) 
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Noitcdrce  rnggagomli 

We  begin  by  introducing  the  following  hypothesis: 

I.  G$  (•)  is  right  invertible  and  minimum  phaae. 

II.  G»i  (s)  ia  left  invertible  and  minimum  phaae. 

III.  There  exist*  an  m  x  r  rational  matrix  U  (s)  with  no 
poles  in  Re  a  >  0  such  ti. at  G,  (s)  +  G,  (s)  0  (j)  =  0. 

IV.  There  exists  an  p  x  q  rational  matrix  V  (j)  with  no 
poles  in  Re  j  >  0  such  that  G%  (s)  +  V  (a)  Gn i  (a)  =  0. 

Theorem  t:  System  (7)  is 

a.  weakly  residence  time  controllable  by  controller  (8) 
if  and  only  if  ( A,B )  is  stabilizable  and  (E,A)  is  de¬ 
tectable; 

b.  strongly  residence  time  controllable  by  controller  (8)  if 
and  only  if  ( A,B )  is  stabilizable,  (£,A)  is  detectable 
and  either  I  and  IV  or  II  and  III  are  true. 

Remark  l:  In  SISO  case  with  D  =  E,  Theorem  2  implies 
that  for  strong  residence  time  controllability  G,  (a)  should 
be  minimum  phase. 

The  following  results,  derived  earlier  in  Meerkov  and 
Runolfsson  (1988,  198S),  for  systems  with  state  feedback 
control  laws,  u  =  Kx,  can  be  derived  from  Theorem  2. 

Corollary  I:  Assume  that  E  —  [  (the  n  x  n  identity 
matrix).  Then  system  (7)  is 

a.  uni-controllable  by  controller  (8)  if  and  only  if  (A,  B) 
is  stabilizable; 

b.  art -controllable  if  and  only  if  (A,  B)  is  stabilizable  and 
III  is  true. 

For  the  special  case  when  the  controlled  output  is  the  whole 
state  vector  we  have: 

Corollary  t:  Assume  D  -  l.  Then  system  (7)  is  art- 
controllable  if  and  only  if  (A,  B)  is  stabilizable  and  (mCC 
Im  B. 

Remark  t:  Note  that  I  is  a  stronger  condition  than  III. 
Thus,  either  IV  or  II  is  the  additional  condition  that  has 
to  be  satisfied  when  state  feedback  is  replaced  by  output 
feedback. 


Noisy  measurements 

Tktartm  3:  Let  P  be  the  unique  positive  definite  solution 
of  the  Riccati  equation 

AP  +  PAt  +  CCT  -  PEt  (FFT) EPm  0.  { U) 

Then  the  maximal  logarithmic  residence  time  of  the  closed 
loop  system  (7),  (9)  in  If  satisfies 

u’^miniu  T(DPDTY\.  (15) 


Remark  3:  It  follows,  in  particular  from  Theorem  3  that 
since  the  upper  bound  in  (15)  is  always  finite,  system  (7) 
with  control  (9)  is  never  strongly  residence  time  control¬ 
lable.  Therefore,  the  measurement  noise  has  a  greater  lim¬ 
iting  effect  on  the  achieveabte  residence  time  than  the  in¬ 


put  noise  in  (7). 

The  following  theorem  illustrates  that  the  upper  bound  in 
(15)  is  the  best  possible  bound. 

Theorem  4:  The  upper  bound  in  (15)  is  attained  if  and 
only  if  there  exists  a  rational  matrix  W  (s)  with  no  poles 
in  Re  s  >  0  such  that 

G,(s)  +  G.(s)W(a)  =  0  (16) 

where  G,  (a)  is  defined  as  previously  and 

G,{s)  =  D(sl -  A)~'  L, 

L=PET(FFTyl.  (!,) 


DESIGN  TECHNIQUES 

In  the  last  section  we  characterized  the  achievable  resi¬ 
dence  time  in  systems  with  observer  based  control  laws 
and  noise- free  and  noisy  measurements.  In  this  section  wc 
develop  controller  design  techniques  that  achieve  (or  ap¬ 
proach)  the  maximal  logarithmic  residence  time.  We  will 
concentrate  on  the  noisy  measurement  case  and  illustrate 
how  the  noise- free  case  as  well  a*  state  feedback  can  be 
obtained  in  a  similar  way. 

Assume,  for  simplicity,  that  the  domain  if  is  an  elliosoid 

*  =  {peR'|yrSy<r1,S  =  Sr>0}.  (18) 

Let  W  e  Rf*r  be  a  nonsingular  matrix  such  that  5  = 
WWT.  Then  a  straight  forward  calculation  gives 

r» 

^ K,L)  =  2Xmu\WDX(K,L)DT\Vt)  (19) 

where  (•)  denote*  the  maximum  eigenvalue  of  a  sym¬ 
metric  matrix  and  X  (K,  L)  is  defined  by 


r  a 

BK  1 

[  X  (K,L) 

T(A',L)1 

A  +  BK-LE J 

[Tt(K,D 

X(K,L)\ 

[  X(K,L) 

T(K,L) 

f  A 

BIC  1 

[ Tt(K,L) 

X(K,L) 

A  +  BK-LE  J 

,  CCT  0 

+  0  lfftlt 

(20) 

From  (19)  we  conclude  that  a  pair  (K,  Li)  is  optimal  if  nnd 
only  if  it  minimize*  the  largest  eigenvalue  of  r(K,  L)  =» 
WDX  ( K,L)DtWt .  The  following  lemma,  whose  proof 
is  similar  to  the  proof  of  Theorem  2.1  in  Allwright  and  Mao 
(1982),  characterize*  the  minimum  value  of  Arrux  (r  (A',  L)\. 

Lemma  1:  Let  9  >  0  be  a  scalar,  I  >  1  be  an  integer  and 
•elect  Ki  €  K  and  Li  g  L  such  that 

Tt  r (KltL,)'  <  (1  +8)  inf  Tr  T(K,L)' .  (21) 

n£Ktlicb 

Then 

,lim  An^jr (K,,Lt)\  =  inf  Am„(r(A'.I)|.  (22) 

f— oo  a€K,£€L 
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(32) 


U  follows  from  the  lemma  that  in  order  to  minimize 
^rmx  (r  (K,  L)),  it  suffices  to  minmize  IV  V(K,  L)1  for  l  = 
1,2,3,....  To  accompliih  thii  introduce  the  regularized 
“coet" 

j'y(K,L)=  Tt(r(K,l)‘+iKX(K,L)K- 

where  X  (K,  A)  is  given  by  (20). 

Lemma  t:  Assume  7C,7  6  K  and  L]  6  L  minimize 
J\(I<,L).  Then 

Um  A  (if? ,L1)  =  K€|nf  etT V  r(7C,L)'.  (24) 


From  Lemmas  1  and  2  we  obtain 


Corollary  3:  Assume  that  the  pair  (Tf7,  A7)  €  K  x  L 
minmizes  J\(K,L).  Then 

UmKm  ii(Kt,Ll)=p.  (25) 


A  necessary  condition  for  the  optimality  of  (KJ,  A7)  in  the 
sense  of  minmizing  functional  (23)  is  given  in  the  following 
theorem. 

Theorem  5:  Assume  that  (7f7,  A7)  6  K  x  L.  Then  in  order 
for  (7f7,  A7)  to  minimize  Jl,  {K,  A)  it  is  necessary  that 

L]  =  L  =  PEr  (FFry\  (26) 

K}  =  -\btQ]  (27) 

where  P  is  given  by  (14)  and 
ATQ]  +  QjA  +  DtWtM?WD  -  i Q]BBtQ 7  =  0,  (28) 

Af,7  =  /  {WD  (X]  +  P )  DtWt)  ‘ ,  (29) 

(A  +  BK])  X]  +  X?  (A  +  BKJ)T  +  LlT  =  0.  (30) 


Since  (14)  has  a  positive  solution,  l]  =*  A  €  L,  V7,  l.  The 
following  lemma  gives  a  condition  for  K]  6  K. 

Lemmas  3:  Assume  that  MJ  >  0.  Then  KJ  €  K. 

Remark  4:  It  follows  from  Theorem  5  that  the  optimal 
observation  gam  is  independent  of  the  optimal  control 
whereas  the  optimal  control  gain  depends  on  the  optimal 
observations.  Thus,  a  semi-separation  principle  holds. 

Remark  3:  The  optimal  estimator  (observer)  gain  L  is  tile 
Kalman  filter  gain.  Thus,  the  Kalman  filter  is  optimal 
for  optimization  problem  (13).  Furthermore,  consider  the 
equation  for  the  estimation  error  <  =  z  -  i 

de  =  (A  -  LE)edi  +  e(Cdw  -  LFdv)  (31) 

and  denote  the  logarithmic  residence  time  of  e  in  a  bounded 
domain  T  C  R'  (0  €  T)  by  At  (A).  Then 


At  (A)  =  mm  ierP_l  (A)  c 

where  P  (L)  is  the  positive  definite  solution  of 

(A-LB)P(L)  +  P(L){A-LEf  +  CCT 

+lfftlt  =  0.  (33) 

Since  P  given  by  (14)  satisfies 

P<P(L),VL<=  L,  (34) 

we  conclude  that 

At  (£)  =  min  \eTp-'e  >  At  (A) ,  VA  6  L.  (35) 

Therefore,  the  Kalman  filter  is  optimal  in  the  sense  of 
maximizing  the  logarithmic  estimation  error  residence  time 
in  any  bounded  domain  T  C  71"  (0  6  T). 

Remark  6:  The  optimal  control,  law  for  system  (7)  with 
noise  free  measurements  and  control  law  (8)  can  be  ob¬ 
tained  from  (26)  —  (27)  by  selecting  F  *  al  and  letting 
a  -»  0.  Indeed,  since  the  optimal  estimator  law  for  (7), 
(9)  is  the  Kalman  filter  we  know  horn  the  theory  of  opti¬ 
mal  filtering  that  the  (singular)  optimal  filter  for  (7),  (8) 
is  obtained  in  the  limit  a  -»  0  (see,  e.g.,  Kwakemaak  and 
Sivan  (1972)).  Therefore,  the  maximal  logarithmic  resi¬ 
dence  time  for  (7),  (8)  is 

A’  =  Urn  lim  lim  A  (7f.7-*,A,7,“)  (36) 

I— <j ot-Oo-S  '  I’ll 

where  7f,7,“  and  Ajf,“  are  given  by  (26)  —  (30)  with  FFT  = 
oJ7. 

Remark  7:  The  state  feedback  controller  that  maximizes 
the  logarithmic  residence  time  of  (7)  in  ♦  can  be  con¬ 
stricted  in  a  similar  way  as  the  optimal  controller  in  The¬ 
orem  5.  In  particular,  in  this  case  we  obtain  that  the  con¬ 
troller 

u  =  K7r,  (37) 

K]  =  -~BTQl  (38) 

Ar$7  +  <37A  +  DtWtM]WD  -  i Q]BBTQl  =  0,  (3!)) 

Af,7  =  1  {WDX^DTWT)‘~' ,  (40) 

(a  +  Bkj)  XI  +  X,7  (a  +  Bkj)T  +  CCT  =  0  (41) 

results  in  a  logarithmic  residence  time  ,  filh’Jj.  that 
satisfies 

lim  lim  A  (A-,7)  *  sup  A  (X) .  (42) 

I-oot-S  \  '/  Ketc 


EXAMPLE 
Consider  the  second  order  system 

4-[-°i 

y  =  [0  1  *, 

r  =  (l  0)i+ iff. 

For  this  system 
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Therefore,  since  G,  (s)  =  G,i  (j)  is  minimum  phase,  the 
system  ia  art-controllable  by  controller  (8)  when  F  a  0. 
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'  2/fj  +  |E|‘ 
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As  7  -»  0  equation  (41)  simplifies  considerably.  Indeed,  in 
this  case  Ky  -*  00  and,  thus,  for  small  7  (41)  becomes 


ns  1. 


(50) 


Finally,  this  gives 

Kyns^Fp. 


(51) 


CONCLUSIONS 


It  is  shown  ia  this  paper  that  the  fundamental  bounds  on 
the  achievable  precision  of  aiming  of  linear  systems  per¬ 
turbed  by  white  noise  depend  on  the  locations  of  noomini- 
mura  phase  zeros  of  the  various  transfer  functions  involved, 
and  on  the  dimenmonr  of  the  controlled  and  measured  out¬ 
puts  and  control  and  noise  inputs.  Roughly  spetking,  the 
best  precision  of  aiming  is  obtained  for  minimum  phase 
systems  with  the  number  of  control  inputs  larger  than 
outputs.  Any  desired  residence  time  is  attainable  only  if 
no  measurement  noise  is  present.  Therefore,  the  effect  of 
measurement  noise  is  more  detrimental  on  the  precision  cf 
aiming  than  that  of  the  input  system  noise. 
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APPENDIX 


Output  Residence  Time  Control 

S.  M.  MEERKOV  and  T.  RUNOLFSSON 

Abstract— The  problem  ot  roMnet  time  control,  ietrodeetd  la  (11,  it 
extended  to  system  with  outputs.  Necessary  and  juffkkat  conditions  for 
output  residence  time  controllability  in  linear  systems  with  small,  additive 
noise  are  derived.  Stale  feedback  controller  design  techniques  art 
developed  and  applied  to  a  robotics  control  problem.  The  approach  is 
based  on  an  extension  of  the  asymptotic  first  passage  time  theory  to 
output  processes. 

\#' 
v  V 

V 


II.  Output  residence  Time 
Consider  a  linear  stochastic  system 

dx  ■  Axdt  +  eCtfw 

{  y-Dx  (2.1) 

where  x  €  y  €  fa0,  w (/)  is  a  standard  r-dimensional  Brownian 
motion  and  0  <  e  <  I  is  a  parameter.  It  is  aatumed,  without  loss  of 
generality,  the  rank  D  *  p. 

Let  ♦  C  9 A0  be  an  opea  bounded  domain  containing  the  origin  and 
whose  boundary  d  t  is  smooth  and  define 

Q,-{*€  ♦}. 

€  U‘\DeA'x  e  t,  fiO}. 

Assume  that  x0  »  jr(0)  €  Q0  and  denote  as  y(t,  x0)  the  output  y{t) 
defined  by  (2.1)  with  tlr  initial  condition  x0.  Introduce  the  first  passage 
time  ofy(r,  *0)  fror.,  <s  follows: 

r'(x*>  *  inf  jfaO  :>'{/,  x»)  €  St}  (2.2) 

and  its  mean 

f'(x»)  *  £(  r'(x>)|x>l.  (2-J> 

The  calculation  of  r'  (  jc0)  is.  in  general,  a  difficult  task.  To  alleviate  (his 
difficulty,  asymptotic  approximations  with  respect  to  small  <  can  be  used. 
For  the  special  case  y(t)  ■  jr( /)  these  approximations  have  been 
extensively  discussed  in  the  literature  (sec.  e.g.,  |I)-14|  and  references 


u  v 


I.  Introduction  j- 

Given^a  controlled  dynatqical  system  with  states  x (/)  control 

u(t)  €  output  y(()  €  gW',  and  disturbances  ((f)  6  assume 
its  desired  behavior  is  specified  by  a  pair  {♦.  r},  where  ♦  C  PW'  is  the 
domain  to  which  the  outputs y(t)  should  be  confined  and  r  is/he  period  of 
the  confinement,  \.t.,y(t)  €  ♦,  v/  6  [to,  to  +  r).  t0  G$8».  Problem 
formulation  of  this  form  arises  in  numerous  applications.  For  instance,  in 
the  problem  of  telescope  pointing,  the  domain  ♦  is  defined  by  the  film 
grain  size  and  r  is  the  exposure  time  (see  (1]  for  additional  examples). 

For  a  given  pair  { ♦,  r) ,  the  problem  of  output  residence  time  control 
is  formulated  as  the  problem  of  choosing  a  feedback  control  law,  so  as  to 
force  y(t )  to  remain,  at  least  on  average,  in  ♦  during  period  r,  in  spite  of 
the  disturbances  ((f)  that  are  acting  on  the  system. 

The  purpose  of  the  present  note  is  to  analyze  the  fundamental 
capabilities  and  limitations  of  output  residence  time  control  for  linear 
systems  with  small  additive  perturbations.  The  approach  is  based  on  an 
extension  of  the  asymptotic  first  passage  time  theory  to  output  processes. 

The  structure  of  the  note  is  as  follows:  in  Section  II  the  notion  of  an 
output  residence  time  is  introduced;  in  Section  III  output  residence  time 
controllability  is  defined  and  analyzed;  in  Section  IV  output  residence 
time  controller  techniques  arc  given;  and  in  Section  V  an  example  is 
consideicd.  The  proofs  are  given  in  the  Appendix. 
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therein).  An  extension  to  the  more  general  cats  of  y(t)  *•  £)*(<)  is  given 
below  (see  also  (*)). 

Theorem  2.1:  Assume  that  A  is  Hurwitz  and  (A,  C)  is  completely 
disturbable.  i.e.,  ^mk(C/4C•‘•  y4*_lC]  *  it.  Then  uniformly  for  all 
'x0  belonging  to  compact  subsets  of  Q  we  have 

lim<Jln  f(JC,)-M(+)  (2.4) 

«-Q 

where 

>*(*)=■  min  ^rNy,  N-(0AZ>r)-'  (2.3) 

/eat  2 

and  X  is  the  positive  definite  solution  of 

AX+XA  r+CCr*0.  (2.6) 

Proof:  Sec  the  Appendix. 

The  constant  £(♦)  is  referred  to  as  the  logarithmic  residence  time  in 
♦.  The  properties  of  this  constant,  as  stated  in  Theorem  2. 1 .  constitute  the 
mathematical  foundation  for  the  analysis  in  Sections  111  and  IV. 

If  y  is  a  scalar,  the  logarithmic  residence  time  can  be  expressed  in  a 
more  traditional  form.  Indeed,  since  in  this  case  ♦  is  an  interval,  say,  * 
*  ( -  a,  b),  a,  b  >  0,  and  N  is  a  scalar,  from  (2.5)  it  follows  that 


/!(♦)*  2  (min  (a,  b))lN. 


"-(i 


DeA'CCreA 


T'DT  dt^j  *’  -  ^  j’  Tr  CreAT'DTDeA'C  dt^j  " ' 
(h  f.  I  G«  <'“>1 0.(s)~D(st-A)-'C. 


Therefore. 


m(+) 


min  (a,  b))1 

2I1G.IJ 


(2.7) 


When  y  is  not  a  scalar,  the  simple  relationship  (2.7)  is  not  true.  In  fact,  it 
is  not  difficult  to  show  that  in  general 


.m(*>* 


min  yry 
/eat 


(2.8) 


III.  Output  Residence  Time  COKntoujMiLm’ 

Consider  now  a  controlled  linear  stochastic  system 

dx-(Ax-<rB*)dt  +  tCdw,  it  6  #• 

yDx.  (3.1) 

Let  u  *  Kx  and  let  #'(*»,  K )  te  the  mean  first  passage  time  from  *  of 
the  closed-loop  system 


dx  *  (A  +  BK)xdt  +•  tCdw 

y*Dx  J  (3.2) 

with  initial  conditions  xa  »  x(0)  €  Q*  ■  {x  €^W*|OeM‘**vJr  6  ♦, 
fi  0).  Define 

il(+.  K)  *  lim  In  #'(*»,  K).  (3.3) 

Definition: 

i)  The  output  y(t)  of  system  (3.1)  is  said  to  be  weakly  residence  time 
controllable  (y-wn  controllable)  if  for  any  bounded  domain  ♦  C  fill' 
with  0  in  its  interior,  there  exists  a  control  u  *  Kx  such  that  )!(♦,  K )  > 
0. 

n)  y(t)  is  said  to  be  strongly  residence  time  controllable  (y-sn 
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V 


/ 

I  ♦  cQs*  (0  6  '9 


90  and  ft  >  0  there  exists 


controllable)  if  for  any  bounded 
u  ■  Kx  such  that  £(♦,  K)  5e  js. 

The  following  theorem  characterizes  the  class  of  y-wrt  controllable 
systems. 

Theorem  3.1:  Assume  that  (3.1)  has  no  modes  that  are  both 
uncontrollable  and  undistutbabte.  Then  system  (3. 1)  is  >>-wrt  controllable 
if  (A,  B)  is  stabilizable.  If  (Z>,  A)  is  detectable  then  stabilizabiiity  of  (A, 
B)  is  also  a  necessary  condition  for  y-wrt  controllability. 

Proof:  Sec  the  Appendix. 

The  assumption  that  (3.1)  has  no  modes  that  are  both  uncontrollable 
and  undisturbable,  i . e . ,  (A,  [B  Cl)  is  a  cemrJfUr  pair,  is  assumed  to  be 
true  in  the  remainder  of  the  note.  It  is  made  to  rule  out  some  mathematical 
de^-'eracies.  Methods  for  relaxing  this  assumption  are  discussed  in  [1]. 

Wexi  we  give  conditions  for  y-srt  controllability.  Define  transfer 
matrices 


G,(s)  =  D(sI-A)-'B 


(3.4) 


and 


G.(s)-D(sl-A)-'C. 


(3.5) 


Theorem  3.2:  Assume  ( A ,  9)  is  stabilizable  and  ( D ,  A)  is  detectable. 
Then  (3. 1)  is  y-srt  controllable  if  and  only  if  there  exists  an  m  x  r  rational 
matrix  U{s)  with  no  poles  in  the  open  right-half  complex  plane  such  that 


G„(s)  +  G,(r)£/(i)«  0. 


(3.6) 


& 


Proof:  See  the  Appendix. 

Remark  3.1:  If  G„(s)  and  G,(s)  are  scalars  then  it  follows  from 
Theorem  3  ^  that  (3. 1)  is  y-srt  controllable  ifand  only  if  ail  nonminimum 
phase  zeros  of  G,(s)  are  also  zeros  of  G„(j). 

Remark  3.2:  When  D  is  an  n  x  it  nonsingular  matrix,  i.e..  when  (3. 1) 
has  as  many  outputs  as  states,  condition  (3.6)  becomes  ImC  S  Imfl.  This 
condition  has  been  earlier  derived  in  (11  (see  also  (4|). 

Although  the  above  results  are  formulated  in  terms  of  multivariable 
systems,  to  simplify  the  situation,  in  the  remainder  of  the  note  we  assume 
’hat  y.  u,  and  w  are  scalars  and  address  the  following  problems^  <  — 
Problem  1:  What  is  the  fundamental  bound  on  the  achievable 
-  hmic  residence  time  of  an  output  which  is  not  y-srt  controllable? 

•'  -  blem  2:  How  to  design  a  controller  which  results  in  a  desired  output 
logarithmic  .  Jence  time? 

We  give  the  solution  to  Problem  I  in  this  section  and  tc  Problem  2  in 
Section  IV. 

Let  A  a  \K\A  +  BK  is  Hurwitz}  and  define  the  maxima!  iotarithmic 
'reticence  lime  in  ♦  by 


M*(*)«  sun  /*(t,  K). 


(3.7) 


•.  Jibe 


Obviously.  *!*(♦)  11  o*  for  a  y-srt  controllable  output.  Let  Z|, 
the  open  right-half  pline  (rhp)  zeros  of  G,(r). 

Theorem  3.3:  Assume  {A,  B)  is  stabilizable.  Then  p*(t)  is  given  by 


M*(t)< 


(min  (a,  b))* 

(3.8) 

2IG.I1  1 

9(4) 

I 

(3.9) 

n««) 

where  t,  is  the  complex  conjugate  of  z,  and  q{s)  is  the  unique  polynomial 
of  degree  less  than  /  determined  by  the  interpolation  constraints:  at  each 
rpli  zero  :  of  G,(s)  of  multiplicity  m,  G0(r)  satisfies 

^7  Go(J)l,.,»“  G.(r)|MI,  k*Q,  ••■./»»-  I.  (3.10) 


ds 


Proof:  See  the  Appendix 

Rem  • k  >  The  function  Grt(s)  def  *d  by  (3.9)  is  the  rational 
funcnor.  of  minimum  H:-norm  which  s;  sfics  ihc  interpolation  con- 
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straints  (3. 10)  (5],  [61.  Thu*,  the  problem  (3.7)  it  equivalent  to  the 
problem 


min  (HGDj  :  C(s)  €  //*,  G(s)  rational} 

subject  to  the  constraints  (3.10).  On  th?  other  hand,  the  //"-optimal 
transfer  function  [7]  which  satisfies  the  interpolation  constraints  (3. 10)  is 
an  all  pass  filter,  i.e.,  constant  in  magnitude  on  the  yVaxis.  Thus,  an 
unweighted  //"-optimal,  stabilizing  state  feedback  controller  [81  leads  to 
a  closed-loop  system  with  the  shortest  possible  logarithmic  residence 
time. 

The  formula  (3.8)  for  m*(+)  simplifies  considerably  when  the  rhp  zeros 
of  G,(s)  are  distinct.  Define  an  /  x  /  matrix  Z  by  zv  =*  (Z/  +  £,)"',  1  s 
i,  j  £  /,  and  an  /  Jj^column  vector  g  by  g/  »  G„(Z/).  j  «  1,  *••,/. 
— theorem  J./TXssume  that  the  rhp  zeros  of  G,(s)  are  all  distinct.  Then 


(min  (a,  b ))* 
2  gHZ-'g 


where  gH  is  the  Hermitian  transpose  of  g,  i.e.,  gH  ■  gT. 
Proof:  See  Appendix 


(3.11) 


IV.  Output  Residence  Time  Controller  design 

In  this  section  we  give  a  method  for  selecting  a  controller  which  results 
in  any  admissible  logarithmic  residence  time  £  <  /»•(♦). 

Recall  that  /i( *,  K)  is  given  by 

*(*.*) -5  (min  (a,b))lN(K).  (4.1) 

Thus,  the  maximization  problem  (3.7)  is  equivalent  to  the  minimization 
problem 


inf  DX(K)DT.  (4.2) 

KGK 

Since  the  equation  which  X(K )  satisfies  is  linear  in  K,  it  is  easy  to  see 
that  the  infimum  (4.2)  is  not  attained  at  any  K  €  K.  Thus,  m*(+)  «  not 
attained  for  any  K  €  K.  We  now  construct  a  sequence  of  controllers 
whose  logarithmic  residence  times  aevamge  to  ***(♦)•  Let  Ko  S  X  and 
define  a  regularized  “cost"  - - 

J,[K)*DX{Ko  +  K)DT+yKX{Kt+K)KT,  y>0.  (4.3) 

Obviously, 

,I(*.Ao+/0**”~*'1  KeK-  (4‘4) 

It  is  well  known  from  the  theory  of  optimal  control  [9]  that  /,(£)  is 
minimized  by 


(4.3) 


where  Qy  is  the  positive  senudefinile  solution  of 


(A  ±BK»)TQ,*Qy(A  *SX,)*OrD--QJB*TQy-Q.  (4.6) 


The  following  theorem  can  be  proved  using  the  results  of  [91- 
Theorem  4.1:  Assume  (A,  B)  is  stabilizabfe.  Then  £(♦,  /Co  +  K1)  is 
nondccrcastng  as  y  —  0,  and 


limill*.  *„+£’)«>*•(♦). 

,  -0 


v.  Example 

Example  S.  1:  Consider  the  problem  of  controlling  the  tip  position  of  a 
flexible  robot  arm  using  control  torques  applied  at  the  robot  arms  hub 
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[10].  A  finite -dimensional  approximate  model  for  a  robot  arm  which  is' 
flexible  in  the  horizontal  plane  but  not  in  the  vertical  plane  or  in  torsion 
was  described  in  [10].  The  model  is  described  by  the  following  set  of 
equations: 


y<“lML)  0]x,.  i*0.  I,  (5.1) 


where  L  is  the  length  of  the  arm.  ft,  <•>/,  and  Mi)  (z  €  [0,  L])  are  the 
damping  coefficients,  pinned-frec  frequency,  and  modal  gain,  respec¬ 
tively.  of  the  /th  mode  of  oscillation.  It  is  the  total  moment  of  inertia,  u  is 
the  control  torque,  ft  is  a  random  torque  acting  on  the  tip,  and  y  * 
is  the  tip  position. 

Assume  that  it  is  desired  to  maintain  the  tip  position  within  the  bounds 
-u  S  y  s  b  during  a  specified  time-interval,  T,  and  assume  that  the 
disturbance  |  can  be  modeled  as  a  small  white  noise  t  w. 

The  system  transfer  function  for  (5.1)  is 


ML) 


dMO) 

dz 


j!  +  2f,u^i+oiJ 


(5.2) 


and  the  noise  transfer  function  is 


G,(s)- 


« 

2 


<•0 


d?axs+2f,M.) 

j,  +  2ftwis.+w(2 


(5.3) 


It  was  'ndicatcd  in  [10]  that  taking  n  *  3  gives  a  good  approximate 
model  and  the  values  of  the  constants  ft,  w,,  ML),  d  MWdz  and  /r 
were  determined  experimentally.  The  resulting  system  has  three  right 
half-plane  zeros  at  Zi  ■  12.04  and  zu  ■  21.5  ±  j  25.3.  it  is  easily 
checked  that  G„(Zi)  *  0.  Thus,  system  (5.1)  is  not  /-srt  controllable. 
However,  it  is  controllable  and.  thus  y-wrt  controllable  and  the  maximal 
logarithmic  residence  time  can  be  ottained  from  (3.11)  to  be 


M*(*) 


(min  (<r,  b))1 
2  gHZ-'f 


(min  (g,  b)Y 
2(0.046) 


10.87  (min  (a,  b))x. 


(5.4) 


Thus,  any  specified  time-interval  [0,  71  has  to  satisfy  the  bound 


,  „  10.87  min  («,  b))1 
In  Ts - : - 


(5.5) 


AffENDtX 

Proof  of  Theorem  3. 1:  First  note  diet  it  follows  from  the  definition 
of  flo  that 


inf  [rs0|/(O  €  ft) «iaf  {/*0|jr«)  €  dQ,}.  (A.l) 


Therefore, 

f*(x„  ♦)»£  (inf  {/i0|y(/,  *)  € 

*  [inf  { fi0|jc(f.  *.)  €  dQ*|x,l  -  *•(*,  0»).  (A.2) 

Now.  it  follows  from  [4.  Theorem  4]  that  uniformly  for  xa  belonging  to 
compact  subsets  of  Q  we  have 

lim  In  f(xt,  fl*)*d(Q,)»  min  \xTMx  (A. 3) 

•-»  *€« o* 

where  M  *  X"'  and  X  is  given  by  (2.6). 

To  complete  the  proof  we  show  that  d(flo)  *  £(♦)•  Let  x  *  Tibet 
nonsingular  change  of  coordinates  that  maps  (2.1)  mio  the  form 

*T-'ATidH-tT  'Cdw 
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[&  t]  [i] [c4 

y-DTX-  a.[,  >i  [*  j 


(such  a  T  always  exists  since  tank  D  -  p).  Under  this  change  of 
coordinates  M  is  mapped  into  fit  *  TT  MT  and  the  domains  Q0  and  Q 
become 

S  n’\£,  6  *}, 

fi-U  6  R'\y-6tA%  e  *.  raO}.  (A.3) 

The  logarithmic  residence  time  in  ft0  is  now  given  by 

min 


=  min 
xy  (roc 


5W*n[*5  g“][s]  •  (*•« 


We  minimize  first  with  respect  to  the  unconstrained  variables  i2  giving 

(A.7) 

Substituting  (A.7)  into  (A.6)  and  rearranging  gives 


i(fi«)»  min  r 

/.€(♦  2 


The  matrix  fiu  -A?u  A?["2  is  exactly  where 

[I;  £]  ■ 


*f  ,'/ef :  ^"ii 


Therefore. 


<£{{k)  =  min  riflCii.  (A. 9) 

2 

However,  Xu  *  ^X6r  and  therefore 

d(fi«)»  min  ^if(l5Xtf,')*li|.  (A.10) 

i|€*t2 

Finally,  substituting  back  the  original  coordinates  gives  OXOT  * 
07T"1  X{Tr)-'  TTDT  *  DXDT.  Thus 

♦(fi.)-M(t)«  m»  J>rAy.  (A.  11) 

Q.E.D. 

Proo/  o/  Theorem  3.1:  The  sufficiency  part  of  the  theorem  follows 
directly  from  (1,  Theorem  3.1). 

To  prove  the  necessity  note  that  /-wrt  controllability  implies  that  there 
exists  a  control  u  *  Kx  such  that  DX(K  )DT  >  0.  Assume,  without  loss 
of  generality,  that  the  closed-loop  system  has  the  Kalman  canonic  form. 


An  0  An  0 

a  +  bk-A*  *u  iu  A» 

U  0  A  jj  0 
0  0  An  A44 


.  D*|0,  0  O)  0|.  (A. 12) 


The  subsystem 
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([£  i]  •  [s]) 


is  controllable  and  the  detectability  of  (D,  A )  implies  that  is  Hurwitz. 
If  we  can  show  that  Aj>  is  Hurwitz,  the  proof  is  complete. 

Note  that 


DX(K)Dr~[D,  Dy] 


'x„  AT.jirofl 

L°>rJ 


•  6Jt6T  (A.  13) 


where  X,j,  1  S  i,  j  s  4  is  a  decomposition  of  X(K)  compatible  with 
(A.  12).  Also,  £  satisfies  the  Lyapunov  equation 

AX+XAr+C£r*0  (A.  14) 


*•[*>"  £]•  c-[c]- 


The  pair  (/5,  A)  is  observable.  Therefore,  by  (II.  Corollary  I]  all 
eigenvalues  of  A  in  Re  s  £  0  are  undisturbable.  However,  since  [A,  [fl 
C|)  is  controllable,  we  can  assume  that  (A  +  BK,  C)  is  a  disturbable  pair 
(otherwise  an  arbitrarily  small  change  in  K,  say  &K,  will  render  ( A  + 
B(K  +  SX),  C)  disturbable  [12|).  Therefore,  (A,  C)  is  a  disturbable 
pair  and,  thus.  A  is  Hurwitz.  Q.E.D. 

Proof  of  Theorem  3.2:  The  proof  is  a  simple  application  of  the 
results  in  (91  and  {13].  U  is  easy  to  show  that  _ _ 

min  yry  p  Jua  yTy 

2  T?DX{K)DfSi(il'  *)52t/ DX(K)Dr  '  <A  l5) 

Thus,  y-stt  controllability  is  equivalent  to 

inf  Tr  DX(K)Dr~Q.  (A.  16) 

KC.K 

It  follows  from  the  results  of  (9)  that 


inf  Tr  DX(K)DT-\mTr  DX(K')DT 

KSK  »“• 


Furthermore, 


A  rQ ,  +  Q,A  +  DTD- -  Q,BBrQy-0. 


lim  Tr  DX(K')DT~  lim  Tr  CTQ,C. 

1-*  T~* 


Thus,  it  follows  from  (A.  17)  and  (A.  18)  that  (3.1)  isy-sn  controllable  if 
and  only  if 

lim  crQ,c,*0,  /■!,•'•,  r  (A. 19) 

where  C  ■  [c(  *  •  ■  £■,].  Now  by  (13.  Theorem  Ij.  (A.  19)  is  true  if  ahu 
only  if  there  exist  rational  m-vectors  u,(s),  /  «  1,  * ■ • .  with  no  poles  in 
Re  s  >  0  such  that 


DUI-A)-'[Bu,[i)  +  cl]’‘0,  /*!. 


or  equivalently 


G,(s)t/(r)  +  G.(s)«0 


where  C/(s)  *  (u,(s)  u,(s)|.  Q.E.D. 

Proof  of  Theorem  3.3:  We  know  from  (2.7)  and  Theorem  4,  t  that 

, .  .  (min  to,  b));  , .  ,,, 

,-o  2 1]  G,  I)  $ 
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where 

Gy(s)~G,(s,  J ty)~D(s!-A-BRy)-'C,  Ry^K„+K\  (A. 22) 

Note  that  Gy(s)  can  be  rewritten  u 
Gy(s)*D(sl-A-BRy)-'C 

- D(sl-A)-'C+D(sl-A-BRy)-'BR,(sI-AY'C .  (A.23) 
Let 


DW-zO-'C-lg 

(A.24a) 

DUI-A-BH,r‘  B.ffi 

(A.24b) 

(A. 24c) 

and  note  that  dy(s)  ■  del  (si  -  A  -  BRy)  is  Hurwitz  for  all  y  >  0  and 
my(s)  *  Ry  adj  (si  -  A  )C  is  a  polynomial  of  degree  less  than  n.  Then 
(A.23)  becomes 


G,(s) 


a(s)dy(s)  +  n(s)my(s) 
d(s)dy(s)  . 


(A.24d) 


Note  that  dy(s)  is  the  denominator  polynomial  of  Gy(s);  I'terefore,  d(s) 
divides  a(s)dy(s)  +  n(s)my(s)  for  all  y  >  0.  Write  n(j'/  *  ri,<j)n,(s) 
where  n,(s)  has  zeros  only  in  Re  s  £  0  and  n,(s)  has  zeros  in  Rc  s  >  0 
only.  It  can  be  shown  that  yfy  dy(s)  —  rt/(s)rt,(-s)rsy  —  0  [14]  and 
■n fy  Ry  —  R  as  y  -*  0  [9].  Thus. 


Go(s) « lim  Gy(s) 
>-0 


a(s)ni(s)n,( -s)  +  n,(s)nt(s)m»(s) 
d(s)n,(s)n,(-s ) 


a(s)n.(-s)  +  n,(s)nul(s) 
d(s)n,(-s) 


(A.23) 


where  m0(s)  *  R  adj  (si  -  A)C.  From  the  previous  discussion  we 
know  that  a(s)n,(-s)  +  n,(s)mt(s)  *  d(s)q(s)  for  some  polynomial 
q(s).  Furthermore,  since  the  degrees  of  a(s)  and  mt(s)  are  less  than  n 
and  n,(s)  has  degree  /,  it  follows  that  q(s)  has  degree  less  than  /. 

It  follows  from  (A.23)  that  G0(s)  satisfies  the  constraints 


~C7.(r)|(.«-^G,(i)U.  *»0,  m-  1  (A.26) 


at  each  nonminimum  phau  zero  of  G,(t)  of  muhipiicity  m.<h 
^Therefore”  - - " 


°»(*)“f#T»  <A-27) 

“»v  ~s) 

and  q (s)  is  uniquely  determined  by  (A.26).  Q.E.D. 

Proof  of  Theorem  3.4:  By  a.  sumption,  the  nonminimum  phase 

zeros  of  G,(s)  arc  distinct.  Thcreforo,  we  can  rewrite  G0(s)  as 

-L  / 

(A.28) 

r-1 

where  t,,j  *  1.  •  •  *,  /  arc  some  constants.  At  each  z,  wc  have  [from 
(3.I0)| 

Go(Z.)’‘'£-rZ7*G.(z.)~l.  (A. 29) 

,.i  '> 


Thus.  (A. 29)  gives  /  equations  which  can  be  written  in  matrix  notation  as 


* 


AC  10-17  8930289 


Gtlley  9 


where  tT  »  (f i,-*-,  0)  and  Z  and  g  are  defined  as  previously. 

Next  we  calculate  ]jGolj> 

-iLgsfcSA* 

*  s.  s  L.  du 

=  2^7  !  (i^sKi-s)}  *■  (A-3l) 

Using  the  calculus  of  residues  to  evaluate  the  integrals  appearing  in  (A. 3 1) 
gives 

r  - A* - ds-lrj^L.  (A.32) 


KMI-S^-a- 


Substituting.  <  *  Z_,g  from  (A.30)  (note  that  Z  is  an  invertible 
Hcrmitian  matrix)  gives 

i|G,H!«*"Z-'g  (A. 34) 

and  (3. 1 1)  follows  from  (A.34)  and  (3.8).  Q.E.D. 
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